Nov 06 08:11:18 devstack cinder-volume[76083]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 08:11:18 devstack cinder-volume[76083]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 08:11:18 devstack cinder-volume[76083]: we strongly recommend against using it for new projects.
Nov 06 08:11:18 devstack cinder-volume[76083]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 08:11:18 devstack cinder-volume[76083]: framework.  For more detail see
Nov 06 08:11:18 devstack cinder-volume[76083]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 08:11:18 devstack cinder-volume[76083]:   import eventlet  # noqa
Nov 06 08:11:21 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 08:11:21 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 08:11:21 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 08:11:22 devstack cinder-volume[76083]: INFO dbcounter [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Registered counter for database cinder
Nov 06 08:11:22 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:11:22 devstack cinder-volume[76083]: DEBUG dbcounter [-] [76083] Writer thread running {{(pid=76083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 08:11:22 devstack cinder-volume[76083]: INFO cinder.rpc [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 08:11:22 devstack cinder-volume[76083]: INFO cinder.rpc [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 08:11:22 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:11:22 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Determined volume DB was empty at startup.
Nov 06 08:11:22 devstack cinder-volume[76083]: DEBUG cinder.volume.manager [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76083) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 08:11:22 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 06 08:11:22 devstack cinder-volume[76083]: WARNING stevedore.named [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 08:11:22 devstack cinder-volume[76083]: WARNING castellan.key_manager [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 08:11:22 devstack cinder-volume[76083]: WARNING cinder.keymgr.conf_key_mgr [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 08:11:22 devstack cinder-volume[76083]: DEBUG cinder.volume.drivers.lvm [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76083) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 06 08:11:22 devstack cinder-volume[76083]: DEBUG oslo_concurrency.processutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_concurrency.processutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] CMD "cinder-rtstool verify" returned: 0 in 0.526s {{(pid=76083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:11:23 devstack cinder-volume[76083]: INFO cinder.rpc [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 06 08:11:23 devstack cinder-volume[76083]: INFO cinder.rpc [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 06 08:11:23 devstack cinder-volume[76083]: WARNING stevedore.named [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 08:11:23 devstack cinder-volume[76083]: WARNING castellan.key_manager [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 08:11:23 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:11:23 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Starting 1 workers
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Started child 76235 {{(pid=76083) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Full set of CONF: {{(pid=76083) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] ******************************************************************************** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Configuration options gathered from: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] ================================================================================ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] allow_availability_zone_fallback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] allow_compression_on_image_upload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] allowed_direct_url_schemes     = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] api_rate_limit                 = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] auth_strategy                  = keystone {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] az_cache_duration              = 3600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76235]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_availability_zone      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_host                   = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_name                   = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_stats_polling_interval = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backup_api_class               = cinder.backup.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backup_name_template           = backup-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backup_use_same_host           = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backup_use_temp_snapshot       = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] chap_password                  = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] chap_username                  =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_internal_tenant_project_id = faeaccac438f4787985576f434436859 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_internal_tenant_user_id = ea20f0b5ac5444ababa119fafe5c63f1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cloned_volume_same_az          = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cluster                        = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] compression_format             = gzip {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] config_dir                     = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] config_source                  = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] control_exchange               = openstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] debug                          = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] default_availability_zone      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] default_group_type             = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] default_volume_type            = lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] disk_geometry                  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] driver_client_cert             = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] driver_client_cert_key         = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] driver_data_namespace          = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] driver_ssl_cert_path           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] driver_ssl_cert_verify         = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] driver_use_ssl                 = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] enable_force_upload            = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] enable_new_services            = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] enable_unsupported_driver      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] enforce_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] filter_function                = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_api_insecure            = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_api_servers             = ['http://192.168.122.242/image'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_api_ssl_compression     = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_ca_certificates_file    = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_certfile                = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_keyfile                 = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_num_retries             = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance_request_timeout         = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] goodness_function              = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76235]: INFO cinder.volume.manager [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] graceful_shutdown_timeout      = 5 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] group_api_class                = cinder.group.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] host                           = devstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_compress_on_upload       = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_conversion_address_space_limit = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_conversion_cpu_limit     = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_conversion_disable       = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_introspection_address_space_limit = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_introspection_cpu_limit  = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_upload_use_cinder_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_upload_use_internal_tenant = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_volume_cache_enabled     = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_volume_cache_max_count   = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] image_volume_cache_max_size_gb = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] init_host_max_objects_retrieval = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] iscsi_target_flags             =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] iscsi_write_cache              = on {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] iser_helper                    = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] iser_ip_address                = 192.168.122.242 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] iser_port                      = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_color                      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_config_append              = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_dir                        = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_file                       = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_options                    = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_rotate_interval            = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_rotate_interval_type       = days {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] log_rotation_type              = none {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] max_age                        = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] max_logfile_count              = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] max_logfile_size_mb            = 200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] max_over_subscription_ratio    = 20.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] message_reap_interval          = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] message_ttl                    = 2592000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] migration_create_volume_timeout_secs = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] monkey_patch                   = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] monkey_patch_modules           = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] my_ip                          = 192.168.122.242 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] no_snapshot_gb_quota           = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] num_iser_scan_tries            = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] num_shell_tries                = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] num_volume_device_scan_tries   = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] nvmeof_conn_info_version       = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] nvmet_ns_id                    = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] nvmet_port_id                  = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] osapi_max_limit                = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] osapi_volume_ext_list          = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] osapi_volume_listen_port       = 8776 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] osapi_volume_use_ssl           = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] osapi_volume_workers           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] per_volume_size_limit          = -1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] periodic_fuzzy_delay           = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] periodic_interval              = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] public_endpoint                = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] publish_errors                 = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] quota_backup_gigabytes         = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] quota_backups                  = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] quota_gigabytes                = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] quota_groups                   = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] quota_snapshots                = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] quota_volumes                  = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] rate_limit_burst               = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] rate_limit_except_level        = CRITICAL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] rate_limit_interval            = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] reinit_driver_count            = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] replication_device             = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] report_discard_supported       = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] report_interval                = 120 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] reservation_clean_interval     = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] reservation_expire             = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] reserved_image_namespaces      = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] reserved_percentage            = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] rpc_response_timeout           = 120 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] run_external_periodic_tasks    = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] scst_target_driver             = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] scst_target_iqn_name           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_down_time              = 720 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] shell_completion               = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] snapshot_name_template         = snapshot-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] snapshot_same_host             = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] split_loggers                  = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] state_path                     = /opt/stack/data/cinder {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] storage_availability_zone      = nova {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] storage_protocol               = iSCSI {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] syslog_log_facility            = LOG_USER {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] target_helper                  = lioadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] target_ip_address              = 192.168.122.242 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] target_port                    = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] target_protocol                = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] target_secondary_ip_addresses  = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] trace_flags                    = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] transport_url                  = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] until_refresh                  = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] use_chap_auth                  = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] use_default_quota_class        = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] use_journal                    = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] use_json                       = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] use_multipath_for_image_xfer   = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] use_stderr                     = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] use_syslog                     = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] verify_glance_signatures       = enabled {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_api_class               = cinder.volume.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_backend_name            = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_clear                   = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_clear_ionice            = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_clear_size              = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_copy_bps_limit          = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_dd_blocksize            = 1M {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_name_template           = volume-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_service_inithost_offload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volume_usage_audit_period      = month {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] zoning_mode                    = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_concurrency.disable_process_locking = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.auth_type   = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.auth_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.cache       = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.certfile    = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.include_service_catalog = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.insecure    = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.interface   = public {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.keyfile     = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcache_username = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.region_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.service_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.backend                  = dogpile.cache.null {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.backend_argument         = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.backend_expiration_time  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.config_prefix            = cache.oslo {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.debug_cache_backend      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.enable_retry_client      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.enable_socket_keepalive  = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.enabled                  = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack sudo[76239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 06 08:11:23 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.expiration_time          = 600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.hashclient_retry_attempts = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.memcache_dead_retry      = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.memcache_sasl_enabled    = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.password                 = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.proxies                  = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.redis_db                 = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.redis_server             = localhost:6379 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.retry_attempts           = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.retry_delay              = 0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.socket_keepalive_count   = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.socket_keepalive_idle    = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.socket_keepalive_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.socket_timeout           = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.tls_allowed_ciphers      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.tls_cafile               = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.tls_certfile             = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.tls_enabled              = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.tls_keyfile              = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cache.username                 = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] coordination.backend_url       = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.asyncio_connection    = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.asyncio_slave_connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.backend               = sqlalchemy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.connection            = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.connection_debug      = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.connection_parameters =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.connection_recycle_time = 3600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.connection_trace      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.db_inc_retry_interval = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.db_max_retries        = 20 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.db_max_retry_interval = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.db_retry_interval     = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.max_overflow          = 50 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.max_pool_size         = 5 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.max_retries           = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.mysql_wsrep_sync_wait = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.pool_timeout          = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.retry_interval        = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.slave_connection      = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.sqlite_synchronous    = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.synchronous_reader    = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] database.use_db_reconnect      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_tracing.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.connection_string     = messaging:// {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.enabled               = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.es_doc_type           = notification {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.es_scroll_size        = 10000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.es_scroll_time        = 2m {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.filter_error_trace    = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.hmac_keys             = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.sentinel_service_name = mymaster {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.socket_timeout        = 0.1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.trace_requests        = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler.trace_sqlalchemy      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler_jaeger.process_tags   = {} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler_jaeger.service_name_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] profiler_otlp.service_name_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.enforce_new_defaults = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.policy_default_rule = default {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] privsep_osbrick.group          = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] privsep_osbrick.helper_command = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] privsep_osbrick.user           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_sys_admin.group         = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_sys_admin.helper_command = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] cinder_sys_admin.user          = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.auth_section      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.auth_type         = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.cafile            = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.certfile          = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.collect_timing    = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.insecure          = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.keyfile           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.send_service_user_token = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.split_loggers     = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.timeout           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.tls_ciphers       = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] service_user.tls_min_version   = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.auth_section            = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.auth_type               = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.certfile                = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.collect_timing          = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.insecure                = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.keyfile                 = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.region_name             = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.split_loggers           = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.timeout                 = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.tls_ciphers             = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] glance.tls_min_version         = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.chap_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.chap_username =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.disk_geometry = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.driver_use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.extra_capabilities = {} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.filter_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.goodness_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.iscsi_target_flags =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.iscsi_write_cache = on {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.iser_port     = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.lvm_share_target = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.lvm_type      = auto {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.num_shell_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.report_discard_supported = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.reserved_percentage = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.target_helper = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.target_port   = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.target_protocol = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.trace_flags   = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.unique_fqdn_network = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.use_chap_auth = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_backend_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_clear  = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_clear_size = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_reports.file_event_handler = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_reports.log_dir           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.backend_host       = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.chap_password      = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.chap_username      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.disk_geometry      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.extra_capabilities = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.filter_function    = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.goodness_function  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.iser_helper        = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.iser_port          = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.lvm_type           = auto {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.report_discard_supported = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.reserved_percentage = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.scst_target_driver = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.storage_protocol   = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.target_ip_address  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.target_port        = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.trace_flags        = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_clear       = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] lvmdriver-1.volumes_dir        = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_notifications.driver = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_notifications.retry = -1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] key_manager.fixed_key          = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.barbican_api_version  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.barbican_endpoint     = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.barbican_endpoint_type = public {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.barbican_region_name  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.cafile                = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.certfile              = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.collect_timing        = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.insecure              = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.keyfile               = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.number_of_retries     = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.retry_delay           = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.send_service_user_token = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.split_loggers         = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.timeout               = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.tls_ciphers           = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.tls_min_version       = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.verify_ssl            = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican.verify_ssl_path       = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.auth_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.cafile   = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.keyfile  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.timeout  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] barbican_service_user.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.approle_role_id          = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.approle_secret_id        = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.auth_method              = approle {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.auth_path                = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.kv_mountpoint            = secret {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.kv_path                  = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.kv_version               = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.namespace                = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.root_token_id            = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.ssl_ca_crt_file          = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.timeout                  = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.token_file               = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.token_role               = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.use_ssl                  = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:11:23 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] ******************************************************************************** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 08:11:23 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:23 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:23 devstack sudo[76287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:23 devstack sudo[76287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:24 devstack sudo[76287]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:11:24 devstack cinder-volume[76235]: INFO cinder.brick.local_dev.lvm [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:24 devstack sudo[76409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:11:24 devstack sudo[76409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:24 devstack sudo[76409]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG cinder.brick.local_dev.lvm [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76235) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:24 devstack sudo[76491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:24 devstack sudo[76491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:24 devstack sudo[76491]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:24 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:25 devstack sudo[76682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:25 devstack sudo[76682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:25 devstack sudo[76682]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:25 devstack sudo[76767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 06 08:11:25 devstack sudo[76767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:25 devstack sudo[76767]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.308s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:25 devstack sudo[76849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:11:25 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:25 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:25 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:25 devstack sudo[76853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:11:25 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:26 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.373s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:26 devstack sudo[76937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:11:26 devstack sudo[76937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:26 devstack sudo[76937]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:26 devstack sudo[76943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:26 devstack sudo[76943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:26 devstack sudo[76943]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.324s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:26 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:26 devstack sudo[77030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:26 devstack sudo[77030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:27 devstack sudo[77030]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:27 devstack cinder-volume[76235]: INFO cinder.volume.drivers.lvm [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:27 devstack sudo[77034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:27 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:27 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG cinder.volume.drivers.lvm [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Updating volume stats {{(pid=76235) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:27 devstack sudo[77043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:11:27 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:27 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:27 devstack sudo[77046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:11:27 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:27 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:27 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:27 devstack sudo[77049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:27 devstack sudo[77049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:28 devstack sudo[77049]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:28 devstack sudo[77052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:11:28 devstack sudo[77052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:28 devstack sudo[77052]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:28 devstack cinder-volume[76235]: INFO cinder.volume.driver [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG cinder.volume.driver [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76235) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_db.sqlalchemy.engines [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writer thread running {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG cinder.db.api [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Building query based on filter {{(pid=76235) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG cinder.image.image_utils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76235) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 08:11:28 devstack cinder-volume[76235]: INFO cinder.keymgr.migration [None req-5036c80b-aacb-46d9-bcd5-10b6bf1a6fe3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG cinder.volume.drivers.lvm [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Updating volume stats {{(pid=76235) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:28 devstack sudo[77056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:11:28 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:28 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:28 devstack sudo[77059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:11:28 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:28 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:28 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:29 devstack sudo[77064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:29 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:29 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:29 devstack sudo[77067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:11:29 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:29 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG cinder.manager [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Notifying Schedulers of capabilities ... {{(pid=76235) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:11:29 devstack cinder-volume[76235]: INFO cinder.volume.manager [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Driver initialization completed successfully.
Nov 06 08:11:29 devstack cinder-volume[76235]: INFO cinder.manager [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Initiating service 2 cleanup
Nov 06 08:11:29 devstack cinder-volume[76235]: INFO cinder.manager [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Service 2 cleanup completed.
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG cinder.service [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Creating RPC server for service cinder-volume {{(pid=76235) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG cinder.service [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76235) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 08:11:29 devstack cinder-volume[76235]: INFO cinder.volume.manager [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG cinder.volume.drivers.lvm [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Updating volume stats {{(pid=76235) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 08:11:29 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:29 devstack sudo[77070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:11:29 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:30 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:30 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:30 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:30 devstack sudo[77073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:11:30 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:30 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:30 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:30 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:30 devstack sudo[77078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:11:30 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:30 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:30 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:30 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:11:30 devstack sudo[77084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:11:30 devstack sudo[77084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:11:30 devstack sudo[77084]: pam_unix(sudo:session): session closed for user root
Nov 06 08:11:30 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:11:30 devstack cinder-volume[76235]: INFO cinder.volume.manager [None req-d5ad9874-4c5b-4429-bafb-67c372241a00 None None] Driver post RPC initialization completed successfully.
Nov 06 08:11:33 devstack cinder-volume[76083]: DEBUG dbcounter [-] [76083] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:11:40 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writing DB stats cinder:SELECT=4 {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:11:40 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:12:08 devstack cinder-volume[76235]: DEBUG oslo_service.periodic_task [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running periodic task VolumeManager._thread_info {{(pid=76235) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:12:08 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread count: 6 {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:12:08 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread info: [<_MainThread(MainThread, started 132583815016576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132583700746240)>, <Thread(Thread-3 (stat_writer), started daemon 132583700220096)>, <Thread(Rabbit-heartbeat, started daemon 132583698869568)>, <Thread(Thread-5 (_runner), started daemon 132583699749952)>, <Thread(Thread-7 (_runner), started daemon 132583697762048)>] {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:13:08 devstack cinder-volume[76235]: DEBUG oslo_service.periodic_task [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76235) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:13:08 devstack cinder-volume[76235]: DEBUG cinder.volume.drivers.lvm [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Updating volume stats {{(pid=76235) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 08:13:08 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:13:08 devstack sudo[82192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:13:08 devstack sudo[82192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:13:09 devstack sudo[82192]: pam_unix(sudo:session): session closed for user root
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:13:09 devstack sudo[82195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:13:09 devstack sudo[82195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:13:09 devstack sudo[82195]: pam_unix(sudo:session): session closed for user root
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:13:09 devstack sudo[82198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:13:09 devstack sudo[82198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:13:09 devstack sudo[82198]: pam_unix(sudo:session): session closed for user root
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:13:09 devstack sudo[82201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:13:09 devstack sudo[82201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:13:09 devstack sudo[82201]: pam_unix(sudo:session): session closed for user root
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG cinder.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Notifying Schedulers of capabilities ... {{(pid=76235) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG oslo_service.periodic_task [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running periodic task VolumeManager._thread_info {{(pid=76235) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread count: 6 {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:13:09 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread info: [<_MainThread(MainThread, started 132583815016576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132583700746240)>, <Thread(Thread-3 (stat_writer), started daemon 132583700220096)>, <Thread(Rabbit-heartbeat, started daemon 132583698869568)>, <Thread(Thread-5 (_runner), started daemon 132583699749952)>, <Thread(Thread-7 (_runner), started daemon 132583697762048)>] {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:13:40 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writing DB stats cinder:SELECT=1 {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:13:40 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writing DB stats cinder:UPDATE=1 {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:14:08 devstack cinder-volume[76235]: DEBUG oslo_service.periodic_task [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76235) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:14:08 devstack cinder-volume[76235]: DEBUG cinder.volume.drivers.lvm [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Updating volume stats {{(pid=76235) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 08:14:08 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:14:08 devstack sudo[83829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:14:08 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:14:09 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root
Nov 06 08:14:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:14:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:14:09 devstack sudo[83849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:14:09 devstack sudo[83849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:14:09 devstack sudo[83849]: pam_unix(sudo:session): session closed for user root
Nov 06 08:14:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:14:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:14:09 devstack sudo[83861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:14:09 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:14:09 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root
Nov 06 08:14:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:14:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:14:09 devstack sudo[83864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:14:09 devstack sudo[83864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:14:10 devstack sudo[83864]: pam_unix(sudo:session): session closed for user root
Nov 06 08:14:10 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:14:10 devstack cinder-volume[76235]: DEBUG cinder.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Notifying Schedulers of capabilities ... {{(pid=76235) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:14:10 devstack cinder-volume[76235]: DEBUG oslo_service.periodic_task [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running periodic task VolumeManager._thread_info {{(pid=76235) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:14:10 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread count: 6 {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:14:10 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread info: [<_MainThread(MainThread, started 132583815016576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132583700746240)>, <Thread(Thread-3 (stat_writer), started daemon 132583700220096)>, <Thread(Rabbit-heartbeat, started daemon 132583698869568)>, <Thread(Thread-5 (_runner), started daemon 132583699749952)>, <Thread(Thread-7 (_runner), started daemon 132583697762048)>] {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:15:08 devstack cinder-volume[76235]: DEBUG oslo_service.periodic_task [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76235) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:15:08 devstack cinder-volume[76235]: DEBUG cinder.volume.drivers.lvm [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Updating volume stats {{(pid=76235) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 08:15:08 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:08 devstack sudo[85359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 08:15:08 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:15:09 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:09 devstack sudo[85362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:15:09 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:15:09 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:09 devstack sudo[85365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 08:15:09 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:15:09 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:09 devstack sudo[85368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 08:15:09 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:15:09 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG cinder.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Notifying Schedulers of capabilities ... {{(pid=76235) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG oslo_service.periodic_task [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] Running periodic task VolumeManager._thread_info {{(pid=76235) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread count: 6 {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:15:09 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-f08d2cb2-6624-4c47-8c67-4e6bee0be29e None None] thread info: [<_MainThread(MainThread, started 132583815016576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132583700746240)>, <Thread(Thread-3 (stat_writer), started daemon 132583700220096)>, <Thread(Rabbit-heartbeat, started daemon 132583698869568)>, <Thread(Thread-5 (_runner), started daemon 132583699749952)>, <Thread(Thread-7 (_runner), started daemon 132583697762048)>] {{(pid=76235) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:15:40 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:15:53 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Caught SIGTERM, stopping children
Nov 06 08:15:53 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Acquiring lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 08:15:53 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Acquired lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 08:15:53 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Releasing lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 08:15:53 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Stop services. {{(pid=76083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 06 08:15:53 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Killing children. {{(pid=76083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 06 08:15:53 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Waiting on 1 children to exit
Nov 06 08:15:54 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Acquiring lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 08:15:54 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Acquired lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 08:15:54 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Releasing lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 08:15:54 devstack cinder-volume[76235]: WARNING amqp [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 08:15:54 devstack cinder-volume[76235]: WARNING amqp [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 08:15:54 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-58be909a-771a-428d-86b1-c6bd14dd5c88 None None] Child 76235 exited with status 0
Nov 06 08:15:55 devstack cinder-volume[86292]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 08:15:55 devstack cinder-volume[86292]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 08:15:55 devstack cinder-volume[86292]: we strongly recommend against using it for new projects.
Nov 06 08:15:55 devstack cinder-volume[86292]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 08:15:55 devstack cinder-volume[86292]: framework.  For more detail see
Nov 06 08:15:55 devstack cinder-volume[86292]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 08:15:55 devstack cinder-volume[86292]:   import eventlet  # noqa
Nov 06 08:15:57 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 08:15:57 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 08:15:57 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 08:15:57 devstack cinder-volume[86292]: INFO dbcounter [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Registered counter for database cinder
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_db.sqlalchemy.engines [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG dbcounter [-] [86292] Writer thread running {{(pid=86292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 08:15:58 devstack cinder-volume[86292]: INFO cinder.rpc [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 08:15:58 devstack cinder-volume[86292]: INFO cinder.rpc [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_db.sqlalchemy.engines [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:15:58 devstack cinder-volume[86292]: INFO cinder.volume.manager [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Determined volume DB was empty at startup.
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG cinder.volume.manager [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86292) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 08:15:58 devstack cinder-volume[86292]: INFO cinder.volume.manager [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 06 08:15:58 devstack cinder-volume[86292]: WARNING stevedore.named [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 08:15:58 devstack cinder-volume[86292]: WARNING castellan.key_manager [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 08:15:58 devstack cinder-volume[86292]: WARNING cinder.keymgr.conf_key_mgr [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 08:15:58 devstack cinder-volume[86292]: INFO cinder.volume.manager [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_db.sqlalchemy.engines [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:15:58 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Starting 1 workers
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Started child 86514 {{(pid=86292) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Full set of CONF: {{(pid=86292) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] ******************************************************************************** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Configuration options gathered from: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] ================================================================================ {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] allow_availability_zone_fallback = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] allow_compression_on_image_upload = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] allowed_direct_url_schemes     = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] api_rate_limit                 = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] auth_strategy                  = keystone {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_availability_zone      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86514]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_host                   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_name                   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_stats_polling_interval = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backup_api_class               = cinder.backup.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backup_name_template           = backup-%s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backup_use_same_host           = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backup_use_temp_snapshot       = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] chap_password                  = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] chap_username                  =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_internal_tenant_project_id = faeaccac438f4787985576f434436859 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_internal_tenant_user_id = ea20f0b5ac5444ababa119fafe5c63f1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cluster                        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] compression_format             = gzip {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] compute_api_class              = cinder.compute.nova.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] config_dir                     = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] config_source                  = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] control_exchange               = openstack {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] debug                          = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] default_availability_zone      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] default_group_type             = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] default_volume_type            = QuobyteHD {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] disk_geometry                  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] driver_client_cert             = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] driver_client_cert_key         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] driver_data_namespace          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] driver_ssl_cert_path           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] driver_ssl_cert_verify         = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] driver_use_ssl                 = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] enable_new_services            = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] enable_unsupported_driver      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] enabled_backends               = ['QuobyteHD'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] enforce_multipath_for_image_xfer = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] filter_function                = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_api_insecure            = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_api_servers             = ['http://192.168.122.242/image'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_api_ssl_compression     = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_ca_certificates_file    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_catalog_info            = image:glance:publicURL {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_certfile                = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_keyfile                 = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_num_retries             = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance_request_timeout         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] goodness_function              = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] graceful_shutdown_timeout      = 5 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] group_api_class                = cinder.group.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] host                           = devstack {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_compress_on_upload       = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_conversion_address_space_limit = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_conversion_cpu_limit     = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_conversion_disable       = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_introspection_address_space_limit = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_introspection_cpu_limit  = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_upload_use_cinder_backend = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_upload_use_internal_tenant = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_volume_cache_enabled     = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_volume_cache_max_count   = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] image_volume_cache_max_size_gb = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] init_host_max_objects_retrieval = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] instance_format                = [instance: %(uuid)s]  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] iscsi_target_flags             =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] iscsi_write_cache              = on {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] iser_helper                    = tgtadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] iser_ip_address                = 192.168.122.242 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] iser_port                      = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_color                      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86514]: INFO cinder.volume.manager [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86514) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_config_append              = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_dir                        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_file                       = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_options                    = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_rotate_interval            = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_rotate_interval_type       = days {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] log_rotation_type              = none {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] max_age                        = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] max_logfile_count              = 30 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] max_logfile_size_mb            = 200 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] max_over_subscription_ratio    = 20.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] message_reap_interval          = 86400 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] message_ttl                    = 2592000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] migration_create_volume_timeout_secs = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] monkey_patch                   = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] monkey_patch_modules           = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] my_ip                          = 192.168.122.242 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] no_snapshot_gb_quota           = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] num_iser_scan_tries            = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] num_shell_tries                = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] num_volume_device_scan_tries   = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] nvmeof_conn_info_version       = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] nvmet_ns_id                    = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] nvmet_port_id                  = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] osapi_max_limit                = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] osapi_volume_ext_list          = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] osapi_volume_listen_port       = 8776 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] osapi_volume_use_ssl           = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] osapi_volume_workers           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] per_volume_size_limit          = -1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] periodic_fuzzy_delay           = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] periodic_interval              = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] public_endpoint                = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] publish_errors                 = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] quota_backup_gigabytes         = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] quota_backups                  = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] quota_gigabytes                = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] quota_groups                   = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] quota_snapshots                = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] quota_volumes                  = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] rate_limit_burst               = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] rate_limit_except_level        = CRITICAL {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] rate_limit_interval            = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] reinit_driver_count            = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] replication_device             = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] report_discard_supported       = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] report_interval                = 120 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] reservation_clean_interval     = 86400 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] reservation_expire             = 86400 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] reserved_image_namespaces      = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] reserved_percentage            = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] rpc_response_timeout           = 120 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] run_external_periodic_tasks    = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] scst_target_driver             = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] scst_target_iqn_name           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_down_time              = 720 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] shell_completion               = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] snapshot_name_template         = snapshot-%s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] split_loggers                  = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] state_path                     = /opt/stack/data/cinder {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] storage_availability_zone      = nova {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] storage_protocol               = iSCSI {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] syslog_log_facility            = LOG_USER {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] target_helper                  = lioadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] target_ip_address              = 192.168.122.242 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] target_port                    = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] target_protocol                = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] target_secondary_ip_addresses  = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] trace_flags                    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] transport_url                  = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] until_refresh                  = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] use_chap_auth                  = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] use_default_quota_class        = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] use_journal                    = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] use_json                       = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] use_multipath_for_image_xfer   = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] use_stderr                     = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] use_syslog                     = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] verify_glance_signatures       = enabled {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_api_class               = cinder.volume.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_backend_name            = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_clear                   = zero {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_clear_ionice            = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_clear_size              = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_copy_bps_limit          = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_dd_blocksize            = 1M {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_name_template           = volume-%s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_service_inithost_offload = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volume_usage_audit_period      = month {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] zoning_mode                    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_concurrency.disable_process_locking = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.auth_section = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.auth_type   = password {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.auth_version = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.cache       = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.certfile    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.delay_auth_decision = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.http_connect_timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.include_service_catalog = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.insecure    = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.interface   = public {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86514) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.keyfile     = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86514]: WARNING cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 06 08:15:58 devstack cinder-volume[86514]: WARNING cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Running cmd (subprocess): mount.quobyte {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcache_username = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.region_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.service_token_roles_required = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.service_type = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.token_cache_time = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.backend                  = dogpile.cache.null {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.backend_argument         = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.backend_expiration_time  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.config_prefix            = cache.oslo {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.debug_cache_backend      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.enable_retry_client      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.enable_socket_keepalive  = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.enabled                  = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.expiration_time          = 600 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.hashclient_retry_attempts = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.memcache_dead_retry      = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.memcache_pool_maxsize    = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.memcache_sasl_enabled    = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.password                 = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.proxies                  = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.redis_db                 = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.redis_sentinel_service_name = mymaster {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.redis_server             = localhost:6379 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.retry_attempts           = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.retry_delay              = 0.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.socket_keepalive_count   = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.socket_keepalive_idle    = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.socket_keepalive_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.socket_timeout           = 1.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.tls_allowed_ciphers      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.tls_cafile               = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.tls_certfile             = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.tls_enabled              = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.tls_keyfile              = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cache.username                 = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] coordination.backend_url       = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.asyncio_connection    = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.asyncio_slave_connection = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.backend               = sqlalchemy {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.connection            = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.connection_debug      = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.connection_parameters =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.connection_recycle_time = 3600 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.connection_trace      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.db_inc_retry_interval = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.db_max_retries        = 20 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.db_max_retry_interval = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.db_retry_interval     = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.max_overflow          = 50 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.max_pool_size         = 5 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.max_retries           = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.mysql_wsrep_sync_wait = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.pool_timeout          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.retry_interval        = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.slave_connection      = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.sqlite_synchronous    = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.synchronous_reader    = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] database.use_db_reconnect      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_tracing.insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.connection_string     = messaging:// {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.enabled               = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.es_doc_type           = notification {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.es_scroll_size        = 10000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.es_scroll_time        = 2m {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.filter_error_trace    = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.hmac_keys             = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.sentinel_service_name = mymaster {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.socket_timeout        = 0.1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.trace_requests        = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler.trace_sqlalchemy      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler_jaeger.process_tags   = {} {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler_jaeger.service_name_prefix = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] profiler_otlp.service_name_prefix = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.enforce_new_defaults = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.policy_default_rule = default {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.policy_file        = policy.yaml {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] privsep_osbrick.group          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] privsep_osbrick.helper_command = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] privsep_osbrick.user           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_sys_admin.group         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_sys_admin.helper_command = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] cinder_sys_admin.user          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.auth_section      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.auth_type         = password {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.cafile            = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.certfile          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.collect_timing    = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.insecure          = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.keyfile           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.send_service_user_token = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.split_loggers     = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.timeout           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.tls_ciphers       = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] service_user.tls_min_version   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.auth_section            = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.auth_type               = password {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.certfile                = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.collect_timing          = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.insecure                = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.keyfile                 = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.region_name             = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.split_loggers           = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.timeout                 = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.tls_ciphers             = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] glance.tls_min_version         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.backend_availability_zone = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.chap_password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.chap_username =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack quobyte-client[86517]: Reading configuration file: /etc/quobyte/client.cfg
Nov 06 08:15:58 devstack quobyte-client[86517]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.disk_geometry = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.driver_client_cert = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.driver_client_cert_key = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.driver_data_namespace = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.driver_use_ssl = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=86514) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.enable_unsupported_driver = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.extra_capabilities = {} {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86514]: INFO cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee ...
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.filter_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.goodness_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a -c /etc/quobyte/client-cinder.cfg {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.iscsi_target_flags =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.iscsi_write_cache = on {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.iser_helper   = tgtadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.iser_port     = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_host      =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_login     = admin {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_mount_options = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_password  = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_private_key =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:58 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_share_path =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.num_shell_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.nvmet_port_id = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.quobyte_client_cfg = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.quobyte_volume_url = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.replication_device = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.report_discard_supported = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.reserved_percentage = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.scst_target_driver = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.scst_target_iqn_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.storage_protocol = iSCSI {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a -c /etc/quobyte/client-cinder.cfg
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.target_helper = tgtadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.target_port   = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.target_protocol = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.trace_flags   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.unique_fqdn_network = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.use_chap_auth = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_backend_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_clear  = zero {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_clear_ionice = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_clear_size = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_reports.file_event_handler = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_reports.log_dir           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.backend_availability_zone = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.backend_host         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.chap_password        = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.chap_username        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.chiscsi_conf         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.disk_geometry        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.driver_client_cert   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.driver_client_cert_key = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.driver_data_namespace = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.driver_use_ssl       = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.extra_capabilities   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.filter_function      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.goodness_function    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.iser_helper          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.iser_ip_address      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.iser_port            = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.iser_target_prefix   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_host             = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_login            = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_mount_options    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_password         = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_private_key      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_share_path       = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_ssh_port         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.num_shell_tries      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.nvmet_port_id        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.replication_device   = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.report_discard_supported = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.reserved_percentage  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.scst_target_driver   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.storage_protocol     = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.target_helper        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.target_ip_address    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.target_port          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.target_prefix        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.target_protocol      = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.trace_flags          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.use_chap_auth        = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_clear         = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_clear_size    = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] QuobyteHD.volumes_dir          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.ssl      = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_notifications.driver = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_notifications.retry = -1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] oslo_messaging_notifications.transport_url = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] key_manager.fixed_key          = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.barbican_api_version  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.barbican_endpoint     = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.barbican_endpoint_type = public {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.barbican_region_name  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.cafile                = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.certfile              = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.collect_timing        = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.insecure              = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.keyfile               = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.number_of_retries     = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.retry_delay           = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.send_service_user_token = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.split_loggers         = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.timeout               = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.tls_ciphers           = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.tls_min_version       = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.verify_ssl            = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican.verify_ssl_path       = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.auth_section = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.auth_type = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.cafile   = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.collect_timing = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.keyfile  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.split_loggers = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.timeout  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.tls_ciphers = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] barbican_service_user.tls_min_version = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.approle_role_id          = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.approle_secret_id        = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.auth_method              = approle {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.auth_path                = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.kv_mountpoint            = secret {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.kv_path                  = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.kv_version               = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.namespace                = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.root_token_id            = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.ssl_ca_crt_file          = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.timeout                  = 60.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.token_file               = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.token_role               = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.use_ssl                  = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:15:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] ******************************************************************************** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 08:15:59 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.482s {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:15:59 devstack cinder-volume[86514]: INFO cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee succeeded
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=86514) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.491s {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:59 devstack sudo[86622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:15:59 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:15:59 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.240s {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:15:59 devstack cinder-volume[86514]: INFO cinder.volume.driver [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG cinder.volume.driver [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4119873046875, 'free_capacity_gb': 1773.4119873046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86514) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG dbcounter [-] [86514] Writer thread running {{(pid=86514) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG cinder.db.api [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Building query based on filter {{(pid=86514) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG cinder.image.image_utils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86514) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 08:15:59 devstack cinder-volume[86514]: INFO cinder.keymgr.migration [None req-022e16cd-42be-4dee-ae4a-4b71cbf73e8a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=86514) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=86514) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:15:59 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:15:59 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:15:59 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:16:00 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.238s {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG cinder.manager [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Notifying Schedulers of capabilities ... {{(pid=86514) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:16:00 devstack cinder-volume[86514]: INFO cinder.volume.manager [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Driver initialization completed successfully.
Nov 06 08:16:00 devstack cinder-volume[86514]: INFO cinder.manager [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Initiating service 3 cleanup
Nov 06 08:16:00 devstack cinder-volume[86514]: INFO cinder.manager [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Service 3 cleanup completed.
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG cinder.service [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Creating RPC server for service cinder-volume {{(pid=86514) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG cinder.service [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86514) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 08:16:00 devstack cinder-volume[86514]: INFO cinder.volume.manager [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=86514) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=86514) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86514) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:16:00 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:16:00 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:16:00 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Nov 06 08:16:00 devstack cinder-volume[86514]: DEBUG oslo_concurrency.processutils [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.271s {{(pid=86514) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:16:00 devstack cinder-volume[86514]: INFO cinder.volume.manager [None req-d8e5c847-5007-4031-93a3-d4e9af085e99 None None] Driver post RPC initialization completed successfully.
Nov 06 08:16:04 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Caught SIGTERM, stopping children
Nov 06 08:16:04 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Acquiring lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 08:16:04 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Acquired lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 08:16:04 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Releasing lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 08:16:04 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Stop services. {{(pid=86292) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 06 08:16:04 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Killing children. {{(pid=86292) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 06 08:16:04 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Waiting on 1 children to exit
Nov 06 08:16:08 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Acquiring lock "singleton_lock" {{(pid=86514) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 08:16:08 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Acquired lock "singleton_lock" {{(pid=86514) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 08:16:08 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Releasing lock "singleton_lock" {{(pid=86514) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 08:16:08 devstack cinder-volume[86514]: WARNING amqp [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 08:16:08 devstack cinder-volume[86514]: WARNING amqp [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 08:16:08 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-3456513b-968d-47a7-9d28-3cf9b5cfd8ed None None] Child 86514 exited with status 0
Nov 06 08:16:09 devstack cinder-volume[86834]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 08:16:09 devstack cinder-volume[86834]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 08:16:09 devstack cinder-volume[86834]: we strongly recommend against using it for new projects.
Nov 06 08:16:09 devstack cinder-volume[86834]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 08:16:09 devstack cinder-volume[86834]: framework.  For more detail see
Nov 06 08:16:09 devstack cinder-volume[86834]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 08:16:09 devstack cinder-volume[86834]:   import eventlet  # noqa
Nov 06 08:16:11 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 08:16:11 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 08:16:11 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 08:16:12 devstack cinder-volume[86834]: INFO dbcounter [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Registered counter for database cinder
Nov 06 08:16:12 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:16:12 devstack cinder-volume[86834]: DEBUG dbcounter [-] [86834] Writer thread running {{(pid=86834) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 08:16:12 devstack cinder-volume[86834]: INFO cinder.rpc [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 08:16:12 devstack cinder-volume[86834]: INFO cinder.rpc [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 08:16:12 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:16:12 devstack cinder-volume[86834]: INFO cinder.volume.manager [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Determined volume DB was empty at startup.
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG cinder.volume.manager [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86834) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 08:16:13 devstack cinder-volume[86834]: WARNING stevedore.named [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 08:16:13 devstack cinder-volume[86834]: WARNING castellan.key_manager [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 08:16:13 devstack cinder-volume[86834]: WARNING cinder.keymgr.conf_key_mgr [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 08:16:13 devstack cinder-volume[86834]: INFO cinder.volume.manager [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:16:13 devstack cinder-volume[86834]: INFO oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Starting 1 workers
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Started child 87143 {{(pid=86834) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Full set of CONF: {{(pid=86834) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] ******************************************************************************** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] Configuration options gathered from: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] ================================================================================ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] allow_availability_zone_fallback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[87143]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] allow_compression_on_image_upload = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] allowed_direct_url_schemes     = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] api_rate_limit                 = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] auth_strategy                  = keystone {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_availability_zone      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_host                   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_name                   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_stats_polling_interval = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backup_api_class               = cinder.backup.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backup_name_template           = backup-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backup_use_same_host           = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backup_use_temp_snapshot       = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] chap_password                  = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] chap_username                  =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_internal_tenant_project_id = faeaccac438f4787985576f434436859 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_internal_tenant_user_id = ea20f0b5ac5444ababa119fafe5c63f1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cluster                        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] compression_format             = gzip {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] config_dir                     = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] config_source                  = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] control_exchange               = openstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] debug                          = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] default_availability_zone      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] default_group_type             = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] default_volume_type            = QuobyteHD {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] disk_geometry                  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] driver_client_cert             = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] driver_client_cert_key         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] driver_data_namespace          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] driver_ssl_cert_path           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] driver_ssl_cert_verify         = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] driver_use_ssl                 = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] enable_new_services            = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] enable_unsupported_driver      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] enforce_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] filter_function                = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_api_insecure            = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_api_servers             = ['http://192.168.122.242/image'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_api_ssl_compression     = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_ca_certificates_file    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_certfile                = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_keyfile                 = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_num_retries             = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance_request_timeout         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] goodness_function              = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] graceful_shutdown_timeout      = 5 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] group_api_class                = cinder.group.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] host                           = devstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_compress_on_upload       = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_conversion_address_space_limit = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_conversion_cpu_limit     = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_conversion_disable       = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_introspection_address_space_limit = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_introspection_cpu_limit  = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_upload_use_cinder_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_upload_use_internal_tenant = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_volume_cache_enabled     = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_volume_cache_max_count   = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] image_volume_cache_max_size_gb = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] init_host_max_objects_retrieval = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] iscsi_target_flags             =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] iscsi_write_cache              = on {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] iser_helper                    = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] iser_ip_address                = 192.168.122.242 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] iser_port                      = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_color                      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_config_append              = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_dir                        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_file                       = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_options                    = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_rotate_interval            = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_rotate_interval_type       = days {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] log_rotation_type              = none {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87143) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] max_age                        = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] max_logfile_count              = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] max_logfile_size_mb            = 200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] max_over_subscription_ratio    = 20.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] message_reap_interval          = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] message_ttl                    = 2592000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] migration_create_volume_timeout_secs = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] monkey_patch                   = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] monkey_patch_modules           = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] my_ip                          = 192.168.122.242 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] no_snapshot_gb_quota           = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] num_iser_scan_tries            = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] num_shell_tries                = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] num_volume_device_scan_tries   = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] nvmeof_conn_info_version       = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] nvmet_ns_id                    = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] nvmet_port_id                  = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] osapi_max_limit                = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] osapi_volume_ext_list          = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] osapi_volume_listen_port       = 8776 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] osapi_volume_use_ssl           = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] osapi_volume_workers           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] per_volume_size_limit          = -1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] periodic_fuzzy_delay           = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] periodic_interval              = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] public_endpoint                = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] publish_errors                 = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] quota_backup_gigabytes         = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] quota_backups                  = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] quota_gigabytes                = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] quota_groups                   = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] quota_snapshots                = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] quota_volumes                  = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] rate_limit_burst               = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] rate_limit_except_level        = CRITICAL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] rate_limit_interval            = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] reinit_driver_count            = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] replication_device             = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] report_discard_supported       = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] report_interval                = 120 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] reservation_clean_interval     = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] reservation_expire             = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] reserved_image_namespaces      = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] reserved_percentage            = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] rpc_response_timeout           = 120 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] run_external_periodic_tasks    = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] scst_target_driver             = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] scst_target_iqn_name           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_down_time              = 720 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] shell_completion               = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] snapshot_name_template         = snapshot-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] split_loggers                  = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] state_path                     = /opt/stack/data/cinder {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] storage_availability_zone      = nova {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] storage_protocol               = iSCSI {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] syslog_log_facility            = LOG_USER {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] target_helper                  = lioadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] target_ip_address              = 192.168.122.242 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] target_port                    = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] target_protocol                = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] target_secondary_ip_addresses  = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] trace_flags                    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] transport_url                  = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] until_refresh                  = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] use_chap_auth                  = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] use_default_quota_class        = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] use_journal                    = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] use_json                       = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] use_multipath_for_image_xfer   = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] use_stderr                     = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] use_syslog                     = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] verify_glance_signatures       = enabled {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_api_class               = cinder.volume.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_backend_name            = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_clear                   = zero {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_clear_ionice            = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_clear_size              = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_copy_bps_limit          = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_dd_blocksize            = 1M {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_name_template           = volume-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_service_inithost_offload = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volume_usage_audit_period      = month {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] zoning_mode                    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_concurrency.disable_process_locking = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.auth_type   = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.auth_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.cache       = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.certfile    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.include_service_catalog = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.insecure    = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.interface   = public {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.keyfile     = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcache_username = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.region_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.service_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.backend                  = dogpile.cache.null {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.backend_argument         = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.backend_expiration_time  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.config_prefix            = cache.oslo {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.debug_cache_backend      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.enable_retry_client      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.enable_socket_keepalive  = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.enabled                  = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.expiration_time          = 600 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.hashclient_retry_attempts = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.memcache_dead_retry      = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.memcache_sasl_enabled    = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.password                 = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.proxies                  = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.redis_db                 = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.redis_server             = localhost:6379 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.retry_attempts           = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.retry_delay              = 0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.socket_keepalive_count   = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.socket_keepalive_idle    = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.socket_keepalive_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.socket_timeout           = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.tls_allowed_ciphers      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.tls_cafile               = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.tls_certfile             = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.tls_enabled              = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.tls_keyfile              = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cache.username                 = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] coordination.backend_url       = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.asyncio_connection    = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.asyncio_slave_connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.backend               = sqlalchemy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.connection            = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.connection_debug      = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.connection_parameters =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.connection_recycle_time = 3600 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.connection_trace      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.db_inc_retry_interval = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.db_max_retries        = 20 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.db_max_retry_interval = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.db_retry_interval     = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87143) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.max_overflow          = 50 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 06 08:16:13 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Running cmd (subprocess): mount.quobyte {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.max_pool_size         = 5 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.max_retries           = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.mysql_wsrep_sync_wait = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.pool_timeout          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.retry_interval        = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.slave_connection      = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.sqlite_synchronous    = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.synchronous_reader    = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] database.use_db_reconnect      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_tracing.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.connection_string     = messaging:// {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.enabled               = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.es_doc_type           = notification {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.es_scroll_size        = 10000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.es_scroll_time        = 2m {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.filter_error_trace    = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.hmac_keys             = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.sentinel_service_name = mymaster {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.socket_timeout        = 0.1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.trace_requests        = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler.trace_sqlalchemy      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler_jaeger.process_tags   = {} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler_jaeger.service_name_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] profiler_otlp.service_name_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.enforce_new_defaults = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.policy_default_rule = default {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] privsep_osbrick.group          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] privsep_osbrick.helper_command = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] privsep_osbrick.user           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_sys_admin.group         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_sys_admin.helper_command = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] cinder_sys_admin.user          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.auth_section      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.auth_type         = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.cafile            = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.certfile          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.collect_timing    = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.insecure          = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.keyfile           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.send_service_user_token = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.split_loggers     = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.timeout           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.tls_ciphers       = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] service_user.tls_min_version   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.auth_section            = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.auth_type               = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.certfile                = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.collect_timing          = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.insecure                = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack quobyte-client[87150]: Reading configuration file: /etc/quobyte/client.cfg
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.keyfile                 = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.region_name             = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.split_loggers           = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.timeout                 = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.tls_ciphers             = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack quobyte-client[87150]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] glance.tls_min_version         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.chap_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.chap_username =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.disk_geometry = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.driver_client_cert = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.driver_use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.extra_capabilities = {} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.filter_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.goodness_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.iscsi_target_flags =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.iscsi_write_cache = on {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.iser_port     = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_host      =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_login     = admin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_mount_options = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_password  = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_private_key =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_share_path =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.num_shell_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.quobyte_volume_url = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.replication_device = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.report_discard_supported = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.reserved_percentage = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.target_helper = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.target_port   = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.target_protocol = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.trace_flags   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.unique_fqdn_network = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.use_chap_auth = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_backend_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_clear  = zero {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_clear_ionice = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_clear_size = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_reports.file_event_handler = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_reports.log_dir           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.backend_host         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.chap_password        = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.chap_username        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.disk_geometry        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.driver_client_cert   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.extra_capabilities   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.filter_function      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.goodness_function    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.iser_helper          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.iser_ip_address      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.iser_port            = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_host             = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_login            = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_mount_options    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_password         = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_private_key      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_share_path       = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.num_shell_tries      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.replication_device   = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.report_discard_supported = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.reserved_percentage  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.scst_target_driver   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.storage_protocol     = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.target_helper        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.target_ip_address    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.target_port          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.target_prefix        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.target_protocol      = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.trace_flags          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.use_chap_auth        = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_clear         = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_clear_size    = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] QuobyteHD.volumes_dir          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_notifications.driver = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_notifications.retry = -1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] key_manager.fixed_key          = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.barbican_api_version  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.barbican_endpoint     = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.barbican_endpoint_type = public {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.barbican_region_name  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.cafile                = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.certfile              = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.collect_timing        = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.insecure              = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.keyfile               = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.number_of_retries     = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.retry_delay           = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.send_service_user_token = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.split_loggers         = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.timeout               = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.tls_ciphers           = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.tls_min_version       = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.verify_ssl            = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican.verify_ssl_path       = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.auth_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.cafile   = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.keyfile  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.timeout  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.tls_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] barbican_service_user.tls_min_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.approle_role_id          = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.approle_secret_id        = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.auth_method              = approle {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.auth_path                = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.kv_mountpoint            = secret {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.kv_path                  = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.kv_version               = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.namespace                = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.root_token_id            = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.ssl_ca_crt_file          = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.timeout                  = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.token_file               = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.token_role               = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.use_ssl                  = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 08:16:13 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-b0e42bb3-2e2f-4ce0-a870-5b21e7f51e02 None None] ******************************************************************************** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 08:16:13 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.268s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:16:13 devstack cinder-volume[87143]: INFO cinder.volume.driver [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.volume.driver [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4119873046875, 'free_capacity_gb': 1773.4119873046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87143) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_db.sqlalchemy.engines [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87143) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writer thread running {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.db.api [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Building query based on filter {{(pid=87143) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87143) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:16:13 devstack cinder-volume[87143]: INFO cinder.keymgr.migration [None req-72cb1e2d-37b7-4854-b94f-4687bfd18022 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 08:16:13 devstack sudo[87162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:16:13 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:16:13 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:16:13 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:16:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Driver initialization completed successfully.
Nov 06 08:16:14 devstack cinder-volume[87143]: INFO cinder.manager [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Initiating service 3 cleanup
Nov 06 08:16:14 devstack cinder-volume[87143]: INFO cinder.manager [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Service 3 cleanup completed.
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG cinder.service [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Creating RPC server for service cinder-volume {{(pid=87143) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG cinder.service [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87143) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 08:16:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:16:14 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:16:14 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:16:14 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Nov 06 08:16:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:16:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6db49802-61f6-4b3d-a262-8b21fb24e22f None None] Driver post RPC initialization completed successfully.
Nov 06 08:16:23 devstack cinder-volume[86834]: DEBUG dbcounter [-] [86834] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86834) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:16:24 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:16:24 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:16:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:16:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 6 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:16:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Flow 'volume_create_manager' (496a2264-7ed8-4998-80f3-2d1b58642942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eac3e4-d532-4541-a7e6-bfec5958ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eac3e4-d532-4541-a7e6-bfec5958ba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-919135970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a565721e-8488-491d-a638-42fd90ae210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e8194161f14f53a1ea17aa6d3f2544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:11Z,use_quota=True,user_id='d5e8140968844234a36711bdcdd63c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040ccb0f-38fe-4e01-96ac-bee2953b0219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040ccb0f-38fe-4e01-96ac-bee2953b0219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be3dcd3-ee3e-4155-a8dc-d2fe1cb7069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be3dcd3-ee3e-4155-a8dc-d2fe1cb7069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a565721e-8488-491d-a638-42fd90ae210d', 'volume_name': 'volume-a565721e-8488-491d-a638-42fd90ae210d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e93e0e-2467-4829-9974-85586f77c24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e93e0e-2467-4829-9974-85586f77c24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9896c-30a6-49b6-8493-dd8c89ef00b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:10 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Volume a565721e-8488-491d-a638-42fd90ae210d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a565721e-8488-491d-a638-42fd90ae210d', 'volume_size': 1}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-919135970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a565721e-8488-491d-a638-42fd90ae210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e8194161f14f53a1ea17aa6d3f2544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:11Z,use_quota=True,user_id='d5e8140968844234a36711bdcdd63c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Creating volume a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:17:10 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:17:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:11 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d 1073741824
Nov 06 08:17:11 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:11 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d 1073741824" returned: 0 in 0.689s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:11 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d
Nov 06 08:17:11 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:12 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d" returned: 0 in 0.522s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9896c-30a6-49b6-8493-dd8c89ef00b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a565721e-8488-491d-a638-42fd90ae210d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab579d5-217a-4bf3-b6bd-0e32dc022205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Volume volume-a565721e-8488-491d-a638-42fd90ae210d (a565721e-8488-491d-a638-42fd90ae210d): created successfully
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab579d5-217a-4bf3-b6bd-0e32dc022205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Flow 'volume_create_manager' (496a2264-7ed8-4998-80f3-2d1b58642942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-fba496b9-b0ea-41da-9827-2fe2ab480ca5 req-32fb59e3-48be-45ae-96ce-8e9ebf6de0e9 tempest-VolumesSnapshotsTestJSON-2113752655 None] Created volume successfully.
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Flow 'volume_create_manager' (17b940d9-bc21-41fb-8a6f-9eade0e065df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3cb3ec-c8b3-4734-933f-31db90742bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3cb3ec-c8b3-4734-933f-31db90742bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1410909977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96753639-0357-4a07-be79-be6426c0979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d359bbf993784e3fa6883a3a862dbe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:12Z,use_quota=True,user_id='c57cc5d983794f6ca7c8a8066f843a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5692a23d-c883-4372-b256-26c82cab9c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5692a23d-c883-4372-b256-26c82cab9c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701b7804-ac05-4b89-9620-12775ec4ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701b7804-ac05-4b89-9620-12775ec4ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96753639-0357-4a07-be79-be6426c0979e', 'volume_name': 'volume-96753639-0357-4a07-be79-be6426c0979e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a92c15-7bea-46a3-8d88-3fbe799a45de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a92c15-7bea-46a3-8d88-3fbe799a45de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63388667-acdb-424f-acaf-ed6fc546a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Volume 96753639-0357-4a07-be79-be6426c0979e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96753639-0357-4a07-be79-be6426c0979e', 'volume_size': 1}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1410909977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96753639-0357-4a07-be79-be6426c0979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d359bbf993784e3fa6883a3a862dbe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:12Z,use_quota=True,user_id='c57cc5d983794f6ca7c8a8066f843a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Creating volume 96753639-0357-4a07-be79-be6426c0979e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:17:12 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:17:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:12 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e 1073741824
Nov 06 08:17:12 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:13 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e 1073741824" returned: 0 in 0.922s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:13 devstack sudo[88013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e
Nov 06 08:17:13 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:14 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e" returned: 0 in 0.385s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.857s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63388667-acdb-424f-acaf-ed6fc546a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96753639-0357-4a07-be79-be6426c0979e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b8c5a8-639b-4f4c-a048-2d27bbacbd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Volume volume-96753639-0357-4a07-be79-be6426c0979e (96753639-0357-4a07-be79-be6426c0979e): created successfully
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b8c5a8-639b-4f4c-a048-2d27bbacbd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Flow 'volume_create_manager' (17b940d9-bc21-41fb-8a6f-9eade0e065df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Creating offline snapshot a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 of volume a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:17:14 devstack cinder-volume[87143]: INFO oslo.privsep.daemon [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6gc3kxwn/privsep.sock']
Nov 06 08:17:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-891533d5-0aca-414a-93cf-76d53e16e482 tempest-DeleteServersTestJSON-1884350899 None] Created volume successfully.
Nov 06 08:17:14 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6gc3kxwn/privsep.sock
Nov 06 08:17:14 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 06 08:17:16 devstack cinder-volume[87143]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 06 08:17:16 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:16 devstack cinder-volume[87143]: INFO oslo.privsep.daemon [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Spawned new privsep daemon via rootwrap
Nov 06 08:17:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Accepted privsep connection to /tmp/tmp6gc3kxwn/privsep.sock {{(pid=87143) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 06 08:17:16 devstack cinder-volume[87143]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 08:17:16 devstack cinder-volume[87143]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 08:17:16 devstack cinder-volume[87143]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 06 08:17:16 devstack cinder-volume[87143]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88041
Nov 06 08:17:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad43f595-3d59-4458-9f69-d3af164da4a7]: (2,) {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[da97c0dd-8eb6-4c2f-8fe7-f4d31a2af0b7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:17 devstack sudo[88043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d
Nov 06 08:17:17 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:17 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d" returned: 0 in 0.668s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:17 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 1G
Nov 06 08:17:17 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:18 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 1G" returned: 0 in 0.777s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a565721e-8488-491d-a638-42fd90ae210d -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:18 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a565721e-8488-491d-a638-42fd90ae210d -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73
Nov 06 08:17:18 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:18 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a565721e-8488-491d-a638-42fd90ae210d -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" returned: 0 in 0.644s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:18 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 is being set with open permissions: ugo+rw
Nov 06 08:17:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:18 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73
Nov 06 08:17:18 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:19 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:19 devstack sudo[88072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.info
Nov 06 08:17:19 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:19 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.info" returned: 0 in 0.454s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:19 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.info is being set with open permissions: ugo+rw
Nov 06 08:17:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:19 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.info
Nov 06 08:17:19 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:20 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.info" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.162s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-f668acf7-08b1-4d10-a399-2fa90baa0384 req-801ba1f9-d718-4203-ae1c-c3cfa24262e2 tempest-VolumesSnapshotsTestJSON-2113752655 None] Create snapshot completed successfully
Nov 06 08:17:20 devstack cinder-volume[87143]: WARNING py.warnings [req-31beb6bc-85de-4569-bc94-60f1182ad0ff req-a97a299f-7552-42ba-82d6-3e86f22911f4 tempest-DeleteServersTestJSON-1884350899 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 06 08:17:20 devstack cinder-volume[87143]:   .first()
Nov 06 08:17:20 devstack cinder-volume[87143]: 
Nov 06 08:17:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-31beb6bc-85de-4569-bc94-60f1182ad0ff req-a97a299f-7552-42ba-82d6-3e86f22911f4 tempest-DeleteServersTestJSON-1884350899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-31beb6bc-85de-4569-bc94-60f1182ad0ff req-a97a299f-7552-42ba-82d6-3e86f22911f4 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-31beb6bc-85de-4569-bc94-60f1182ad0ff req-a97a299f-7552-42ba-82d6-3e86f22911f4 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-31beb6bc-85de-4569-bc94-60f1182ad0ff req-a97a299f-7552-42ba-82d6-3e86f22911f4 tempest-DeleteServersTestJSON-1884350899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-96753639-0357-4a07-be79-be6426c0979e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e29d540c-4863-49cc-b962-b71beb7dd15d', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:17:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-31beb6bc-85de-4569-bc94-60f1182ad0ff req-a97a299f-7552-42ba-82d6-3e86f22911f4 tempest-DeleteServersTestJSON-1884350899 None] attachment_update completed successfully.
Nov 06 08:17:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "cinder-a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "cinder-quobyte-a565721e-8488-491d-a638-42fd90ae210d" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-quobyte-a565721e-8488-491d-a638-42fd90ae210d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "cinder-quobyte-a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-quobyte-a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Deleting offline snapshot a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 of volume a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] snapshot_file for this snap is: volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4637d6f2-0507-42f3-8373-923dae7dbf9c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:21 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73
Nov 06 08:17:21 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:21 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" returned: 0 in 0.508s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a565721e-8488-491d-a638-42fd90ae210d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00af40f-3bc4-4dc1-9a74-c9fe4b3187a2]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:21 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d
Nov 06 08:17:21 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:22 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d" returned: 0 in 0.603s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:22 devstack sudo[88576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73
Nov 06 08:17:22 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:22 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" returned: 0 in 0.350s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:22 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73
Nov 06 08:17:22 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:22 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d.a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" returned: 0 in 0.305s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-quobyte-a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73" released by "_delete_snapshot" :: held 1.987s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-quobyte-a565721e-8488-491d-a638-42fd90ae210d" released by "delete_snapshot" :: held 2.023s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:23 devstack cinder-volume[87143]: WARNING cinder.quota [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:17:23 devstack cinder-volume[87143]: WARNING cinder.quota [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:17:23 devstack cinder-volume[87143]: DEBUG cinder.quota [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Created reservations ['883bca45-db39-427c-831b-00a517acaacd', '9c7ee664-5adc-4574-9a33-cb1299990860', 'bca3d1b7-dcb4-43ea-ba67-58107cb00df3', '4c521eaf-c05c-406d-bd9d-4336fb7da299'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:17:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Delete snapshot completed successfully.
Nov 06 08:17:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-30fa18a0-28c7-4d5e-b402-f3838c0447cd req-0b5dd96b-76d3-4f93-865c-d587cb092638 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-a9dbebc0-8a2c-473e-87b0-6e97b8ed0e73-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "cinder-a565721e-8488-491d-a638-42fd90ae210d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-a565721e-8488-491d-a638-42fd90ae210d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "cinder-quobyte-a565721e-8488-491d-a638-42fd90ae210d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-quobyte-a565721e-8488-491d-a638-42fd90ae210d" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f2f4a3-6d3f-4999-a9cf-413b3f376ebf]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:24 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d
Nov 06 08:17:24 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:25 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d" returned: 0 in 0.436s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:25 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d
Nov 06 08:17:25 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:25 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a565721e-8488-491d-a638-42fd90ae210d" returned: 0 in 0.418s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-quobyte-a565721e-8488-491d-a638-42fd90ae210d" released by "delete_volume" :: held 0.959s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:25 devstack cinder-volume[87143]: WARNING cinder.quota [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG cinder.quota [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Created reservations ['1410c14a-3843-448a-bd9f-b32da13923b6', '1bc212c9-8749-4ac3-990c-c3d9162d8f40', 'c0850c13-3e33-4964-9c48-fd5a6d84f427', '2bc7667e-ac18-484e-a2c9-ed217d1abe1e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:25 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:17:25 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:26 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.379s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:26 devstack cinder-volume[87143]: DEBUG cinder.manager [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:17:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Deleted volume successfully.
Nov 06 08:17:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-bc9b2f3e-3097-40b1-ae33-68a41ad3359d req-eaaa8d14-c4dd-47ca-819c-71e63b20fcd1 tempest-VolumesSnapshotsTestJSON-2113752655 None] Lock "cinder-a565721e-8488-491d-a638-42fd90ae210d-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-594c41ec-0b0b-409b-a7a8-e4b3761f518b req-99b119c1-50d0-4307-821b-889fc859e2c0 tempest-DeleteServersTestJSON-1884350899 None] Terminate volume connection completed successfully.
Nov 06 08:17:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-594c41ec-0b0b-409b-a7a8-e4b3761f518b req-99b119c1-50d0-4307-821b-889fc859e2c0 tempest-DeleteServersTestJSON-1884350899 None] Deleting attachment e29d540c-4863-49cc-b962-b71beb7dd15d. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:17:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Acquiring lock "cinder-96753639-0357-4a07-be79-be6426c0979e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Lock "cinder-96753639-0357-4a07-be79-be6426c0979e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Acquiring lock "cinder-quobyte-96753639-0357-4a07-be79-be6426c0979e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Lock "cinder-quobyte-96753639-0357-4a07-be79-be6426c0979e" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf97c727-4b46-4928-b57d-01c037bdb5a2]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:28 devstack sudo[88697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e
Nov 06 08:17:28 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:29 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e" returned: 0 in 0.619s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:29 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e
Nov 06 08:17:29 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:29 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96753639-0357-4a07-be79-be6426c0979e" returned: 0 in 0.606s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Lock "cinder-quobyte-96753639-0357-4a07-be79-be6426c0979e" released by "delete_volume" :: held 1.299s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Created reservations ['597eb1a0-773f-4a0c-9e8e-23880bca6e45', '7d58df20-f33d-46ac-b8b0-42058dec975e', '726aab44-8d58-4640-9e13-d6ea5184f818', 'adbe05a7-077e-4d81-be4f-b9bccdf2b6bf'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:29 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:17:29 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:30 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.470s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:17:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Deleted volume successfully.
Nov 06 08:17:30 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:17:30 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-60b780ca-2711-4049-be89-89027f354ea7 tempest-DeleteServersTestJSON-1884350899 None] Lock "cinder-96753639-0357-4a07-be79-be6426c0979e-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:30 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.400s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 8 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:17:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Flow 'volume_create_manager' (29b91a03-00d4-4a1b-9520-5cf1fc7e729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f0ff16-52c9-4ceb-a350-bf3431a3cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f0ff16-52c9-4ceb-a350-bf3431a3cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1395645352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10100deb-b9b3-4d48-a99d-a33b4153f679,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9727fb9d31274c77bdb87ea447a4bd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:32Z,use_quota=True,user_id='a452a4ca7ff8415987680cddf55e2f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aca9518-15b7-4bd3-bfd6-faeaed1b0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aca9518-15b7-4bd3-bfd6-faeaed1b0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d525e1a4-5707-4fc9-b1bc-d6e588ff34f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d525e1a4-5707-4fc9-b1bc-d6e588ff34f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10100deb-b9b3-4d48-a99d-a33b4153f679', 'volume_name': 'volume-10100deb-b9b3-4d48-a99d-a33b4153f679', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7626d9-6373-46df-ab44-4ecdc7b59450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7626d9-6373-46df-ab44-4ecdc7b59450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65551b2f-9b89-490d-aded-324a548b4335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:32 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Volume 10100deb-b9b3-4d48-a99d-a33b4153f679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10100deb-b9b3-4d48-a99d-a33b4153f679', 'volume_size': 1}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1395645352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10100deb-b9b3-4d48-a99d-a33b4153f679,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9727fb9d31274c77bdb87ea447a4bd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:32Z,use_quota=True,user_id='a452a4ca7ff8415987680cddf55e2f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Creating volume 10100deb-b9b3-4d48-a99d-a33b4153f679 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:17:32 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:32 devstack sudo[88784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679 1073741824
Nov 06 08:17:32 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:32 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679 1073741824" returned: 0 in 0.595s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:32 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679
Nov 06 08:17:32 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:33 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679" returned: 0 in 0.460s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:17:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65551b2f-9b89-490d-aded-324a548b4335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10100deb-b9b3-4d48-a99d-a33b4153f679', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72caf9b8-49cc-478a-836d-75cf2edfe87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:33 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Volume volume-10100deb-b9b3-4d48-a99d-a33b4153f679 (10100deb-b9b3-4d48-a99d-a33b4153f679): created successfully
Nov 06 08:17:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72caf9b8-49cc-478a-836d-75cf2edfe87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Flow 'volume_create_manager' (29b91a03-00d4-4a1b-9520-5cf1fc7e729e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a2c515a9-39c5-41b5-8016-8bb491066e10 tempest-VolumesTestJSON-658765713 None] Created volume successfully.
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Flow 'volume_create_manager' (2f572c8e-9cdf-4999-8cb9-5f9f9f0304ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5118e0e-e777-4632-9a1b-212789ff27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5118e0e-e777-4632-9a1b-212789ff27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-883152210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4abb2e-aab8-4890-b1b9-b86bdff118c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec6833ef76af442a998a6a816898a0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:34Z,use_quota=True,user_id='edaadd6066054111b81fa1930e9b506c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9e3794-51be-4711-bdd9-1ba525a93239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9e3794-51be-4711-bdd9-1ba525a93239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae574f2-3c28-4b17-a2b3-519d46be3b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae574f2-3c28-4b17-a2b3-519d46be3b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4abb2e-aab8-4890-b1b9-b86bdff118c9', 'volume_name': 'volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d92a039-6c98-4242-881e-698a6aa53c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d92a039-6c98-4242-881e-698a6aa53c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4a1b35-7bc6-4559-9b48-1bdfa6b75bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Volume 6a4abb2e-aab8-4890-b1b9-b86bdff118c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9', 'volume_size': 1}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-883152210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4abb2e-aab8-4890-b1b9-b86bdff118c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec6833ef76af442a998a6a816898a0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:34Z,use_quota=True,user_id='edaadd6066054111b81fa1930e9b506c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Creating volume 6a4abb2e-aab8-4890-b1b9-b86bdff118c9 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:17:34 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:17:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:34 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9 1073741824
Nov 06 08:17:34 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:35 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9 1073741824" returned: 0 in 0.708s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:35 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9
Nov 06 08:17:35 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Flow 'volume_create_manager' (2578e34c-60ff-4afe-b01b-a02755a712da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72a1929-97e4-4534-99be-33bcdc7719e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72a1929-97e4-4534-99be-33bcdc7719e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1657759568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1af9ff-b6e4-45fa-81a6-295d9b0223aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9727fb9d31274c77bdb87ea447a4bd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:35Z,use_quota=True,user_id='a452a4ca7ff8415987680cddf55e2f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c4884f-226e-427f-8507-ef82f7a80c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c4884f-226e-427f-8507-ef82f7a80c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f70c08f-aaaa-496b-bd31-e26fe2f32640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f70c08f-aaaa-496b-bd31-e26fe2f32640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1af9ff-b6e4-45fa-81a6-295d9b0223aa', 'volume_name': 'volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad11f53e-f5c6-47ed-b46f-5bddc6d97c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad11f53e-f5c6-47ed-b46f-5bddc6d97c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce00611c-05ff-42ee-ba65-d63698094e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Volume dd1af9ff-b6e4-45fa-81a6-295d9b0223aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa', 'volume_size': 1}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:35 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9" returned: 0 in 0.392s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1657759568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1af9ff-b6e4-45fa-81a6-295d9b0223aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9727fb9d31274c77bdb87ea447a4bd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:35Z,use_quota=True,user_id='a452a4ca7ff8415987680cddf55e2f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Creating volume dd1af9ff-b6e4-45fa-81a6-295d9b0223aa {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:17:35 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4a1b35-7bc6-4559-9b48-1bdfa6b75bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdad201-ec00-4ffd-9b25-35c6e7f2e833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:35 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa 1073741824
Nov 06 08:17:35 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Volume volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9 (6a4abb2e-aab8-4890-b1b9-b86bdff118c9): created successfully
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdad201-ec00-4ffd-9b25-35c6e7f2e833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Flow 'volume_create_manager' (2f572c8e-9cdf-4999-8cb9-5f9f9f0304ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:35 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2b28438a-7d4e-4cb6-81f1-4ab93ece2fe3 tempest-VolumesAdminNegativeTest-220648320 None] Created volume successfully.
Nov 06 08:17:36 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa 1073741824" returned: 0 in 0.664s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:36 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa
Nov 06 08:17:36 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:36 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa" returned: 0 in 0.275s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce00611c-05ff-42ee-ba65-d63698094e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b58d2ef-db32-4042-94e2-962e65f3b119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:36 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Volume volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa (dd1af9ff-b6e4-45fa-81a6-295d9b0223aa): created successfully
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b58d2ef-db32-4042-94e2-962e65f3b119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Flow 'volume_create_manager' (2578e34c-60ff-4afe-b01b-a02755a712da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2aede3a4-3b70-434b-8746-6e37e41c4136 tempest-VolumesTestJSON-658765713 None] Created volume successfully.
Nov 06 08:17:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Acquiring lock "cinder-6a4abb2e-aab8-4890-b1b9-b86bdff118c9-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Lock "cinder-6a4abb2e-aab8-4890-b1b9-b86bdff118c9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Acquiring lock "cinder-quobyte-6a4abb2e-aab8-4890-b1b9-b86bdff118c9" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Lock "cinder-quobyte-6a4abb2e-aab8-4890-b1b9-b86bdff118c9" acquired by "delete_volume" :: waited 0.035s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:37 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674015d-ee2c-4a80-ba18-9873af9b96b6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:37 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9
Nov 06 08:17:37 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:38 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9" returned: 0 in 0.555s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:38 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9
Nov 06 08:17:38 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Flow 'volume_create_manager' (e202ab06-0689-45ec-ad87-7da712df7c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66e2c99-3b9f-42bc-86d5-3efe97159162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66e2c99-3b9f-42bc-86d5-3efe97159162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-768041848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab8a5be-c966-4d75-bc8a-a768092e9e1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9727fb9d31274c77bdb87ea447a4bd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:38Z,use_quota=True,user_id='a452a4ca7ff8415987680cddf55e2f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5908fa98-a164-40b1-b1a4-f419b2e6a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5908fa98-a164-40b1-b1a4-f419b2e6a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd37a6d-06fc-460d-a620-e7ef9cd5cab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd37a6d-06fc-460d-a620-e7ef9cd5cab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab8a5be-c966-4d75-bc8a-a768092e9e1c', 'volume_name': 'volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2a525f-695e-4d0b-8c42-68c1218a051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2a525f-695e-4d0b-8c42-68c1218a051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b17f98-9ace-40ac-aa17-0afbf3707652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:38 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Volume cab8a5be-c966-4d75-bc8a-a768092e9e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c', 'volume_size': 1}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-768041848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab8a5be-c966-4d75-bc8a-a768092e9e1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9727fb9d31274c77bdb87ea447a4bd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:17:38Z,use_quota=True,user_id='a452a4ca7ff8415987680cddf55e2f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Creating volume cab8a5be-c966-4d75-bc8a-a768092e9e1c {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:17:38 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:17:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:38 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c 1073741824
Nov 06 08:17:38 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:39 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a4abb2e-aab8-4890-b1b9-b86bdff118c9" returned: 0 in 0.594s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Lock "cinder-quobyte-6a4abb2e-aab8-4890-b1b9-b86bdff118c9" released by "delete_volume" :: held 1.244s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Created reservations ['0988f224-8338-48d0-9265-9c37f6841ebf', '34c702fc-2ad9-476f-a4cf-8da0403c1e3e', 'b4a96782-7d65-4cf6-b06e-fe32b5e11dc1', 'a80eb753-f807-4ba1-9070-29dd8fcdab4c'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:39 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:17:39 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:39 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c 1073741824" returned: 0 in 0.894s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:39 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.439s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:17:39 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c
Nov 06 08:17:39 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Deleted volume successfully.
Nov 06 08:17:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97b7d08e-3c73-4c76-b443-d379a6660d9d tempest-VolumesAdminNegativeTest-220648320 None] Lock "cinder-6a4abb2e-aab8-4890-b1b9-b86bdff118c9-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:40 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:17:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b17f98-9ace-40ac-aa17-0afbf3707652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94511d8f-fe32-4126-8966-7bc842ce180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:17:40 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Volume volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c (cab8a5be-c966-4d75-bc8a-a768092e9e1c): created successfully
Nov 06 08:17:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94511d8f-fe32-4126-8966-7bc842ce180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:17:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Flow 'volume_create_manager' (e202ab06-0689-45ec-ad87-7da712df7c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:17:40 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9ded4dfc-e4e6-446d-af24-d229995981ac tempest-VolumesTestJSON-658765713 None] Created volume successfully.
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Acquiring lock "cinder-cab8a5be-c966-4d75-bc8a-a768092e9e1c-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Lock "cinder-cab8a5be-c966-4d75-bc8a-a768092e9e1c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Acquiring lock "cinder-quobyte-cab8a5be-c966-4d75-bc8a-a768092e9e1c" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Lock "cinder-quobyte-cab8a5be-c966-4d75-bc8a-a768092e9e1c" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51c2a9-35fb-4c76-9b06-4687c25a43e7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:42 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c
Nov 06 08:17:42 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:42 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c" returned: 0 in 0.558s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:42 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c
Nov 06 08:17:43 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:43 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cab8a5be-c966-4d75-bc8a-a768092e9e1c" returned: 0 in 0.349s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Lock "cinder-quobyte-cab8a5be-c966-4d75-bc8a-a768092e9e1c" released by "delete_volume" :: held 0.966s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Created reservations ['918263a0-4502-4f88-9ef4-4cd9c1ed077f', '829f6d40-12b6-4eee-be92-2571343d9931', 'ea7099b0-fe41-40aa-9c01-852558c08c7a', '0f44a7f2-64b9-44f1-b21f-df88198b016d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:43 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:17:43 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:43 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.275s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:17:43 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Deleted volume successfully.
Nov 06 08:17:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bd5122cb-56c3-45d6-88c9-08715391a61a tempest-VolumesTestJSON-658765713 None] Lock "cinder-cab8a5be-c966-4d75-bc8a-a768092e9e1c-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Acquiring lock "cinder-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Lock "cinder-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Acquiring lock "cinder-quobyte-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Lock "cinder-quobyte-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74bc329-d0de-45d7-a31b-daf884c47c8c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:44 devstack sudo[88876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa
Nov 06 08:17:44 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:45 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa" returned: 0 in 0.424s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:45 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa
Nov 06 08:17:45 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:45 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa" returned: 0 in 0.281s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Lock "cinder-quobyte-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa" released by "delete_volume" :: held 0.770s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Created reservations ['acbb0c8c-7389-4860-85e1-e9072c280eab', '8ae17fc5-fe39-4fe8-b9ca-62a8b843e997', '2be2d8a4-3e07-4a89-a250-a00a64ea8079', '57c2fe7a-8ff3-4efd-b27e-f5ccd5b7ef05'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:45 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:17:45 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Acquiring lock "cinder-10100deb-b9b3-4d48-a99d-a33b4153f679-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Lock "cinder-10100deb-b9b3-4d48-a99d-a33b4153f679-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Acquiring lock "cinder-quobyte-10100deb-b9b3-4d48-a99d-a33b4153f679" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Lock "cinder-quobyte-10100deb-b9b3-4d48-a99d-a33b4153f679" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:17:45 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.366s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:17:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Deleted volume successfully.
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcf7814-5f83-4661-a375-39a935ccc58e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:17:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f8278dc-99e1-4657-8672-e7f804abf5d0 tempest-VolumesTestJSON-658765713 None] Lock "cinder-dd1af9ff-b6e4-45fa-81a6-295d9b0223aa-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:46 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679
Nov 06 08:17:46 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:46 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679" returned: 0 in 0.385s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:46 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679
Nov 06 08:17:46 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:46 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10100deb-b9b3-4d48-a99d-a33b4153f679" returned: 0 in 0.269s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Lock "cinder-quobyte-10100deb-b9b3-4d48-a99d-a33b4153f679" released by "delete_volume" :: held 0.731s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Created reservations ['b1f70ac3-35ce-4f46-9510-2f8f90fed73a', '44060bbf-30f4-4462-8971-1ab67660cb70', 'e1b704e3-0578-4f80-ac1f-8b0602a1e168', 'ebba4787-4907-47ef-bc0b-7bb50abe1e60'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:17:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:17:46 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:17:46 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:17:47 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Nov 06 08:17:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.390s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:17:47 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:17:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Deleted volume successfully.
Nov 06 08:17:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6b2160b-6a73-487b-9784-463826b90340 tempest-VolumesTestJSON-658765713 None] Lock "cinder-10100deb-b9b3-4d48-a99d-a33b4153f679-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:17:56 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=61,cinder:INSERT=16,cinder:UPDATE=74,cinder:DELETE=4 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:17:57 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=75,cinder:SELECT=56,cinder:DELETE=9,cinder:INSERT=19 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:18:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-174ef951-3cb2-4f8a-ae3b-0fdb0399b298 tempest-GroupSnapshotsV319Test-405251429 None] Group tempest-GroupSnapshotsV319Test-Group-338286756: creating
Nov 06 08:18:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-174ef951-3cb2-4f8a-ae3b-0fdb0399b298 tempest-GroupSnapshotsV319Test-405251429 None] Group tempest-GroupSnapshotsV319Test-Group-338286756: created successfully
Nov 06 08:18:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-174ef951-3cb2-4f8a-ae3b-0fdb0399b298 tempest-GroupSnapshotsV319Test-405251429 None] Create group completed successfully.
Nov 06 08:18:02 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Flow 'volume_create_manager' (8a0a07ca-68cc-478a-9486-bb4facce69b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0975f167-3dce-4911-81f4-dc828e016d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0975f167-3dce-4911-81f4-dc828e016d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721234189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9524d683-69b5-4cf2-a034-2c32436315fc,host='devstack@QuobyteHD#QuobyteHD',id=be19e623-17b7-4e5b-8a49-904248459ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d9ee2900e34188b538f74c2a6d5c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:18:03Z,use_quota=True,user_id='6e5a9e5d049a4910a5b6bd61c6270f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c469af6-74d0-4fe7-bf37-c97adbe6c5db),volume_type_id=6c469af6-74d0-4fe7-bf37-c97adbe6c5db)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dd56af-f9b8-4046-9013-392e4699914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dd56af-f9b8-4046-9013-392e4699914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07f6d7b-819e-449e-8232-ddaa01ee4330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07f6d7b-819e-449e-8232-ddaa01ee4330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be19e623-17b7-4e5b-8a49-904248459ab4', 'volume_name': 'volume-be19e623-17b7-4e5b-8a49-904248459ab4', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820c6a71-bf4a-459b-b9a9-1377544a805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820c6a71-bf4a-459b-b9a9-1377544a805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d95c74-7a55-46ef-bed6-002de76976d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:03 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Volume be19e623-17b7-4e5b-8a49-904248459ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be19e623-17b7-4e5b-8a49-904248459ab4', 'volume_size': 1}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9524d683-69b5-4cf2-a034-2c32436315fc,created_at=2026-11-06T07:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721234189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9524d683-69b5-4cf2-a034-2c32436315fc,host='devstack@QuobyteHD#QuobyteHD',id=be19e623-17b7-4e5b-8a49-904248459ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d9ee2900e34188b538f74c2a6d5c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:18:03Z,use_quota=True,user_id='6e5a9e5d049a4910a5b6bd61c6270f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c469af6-74d0-4fe7-bf37-c97adbe6c5db),volume_type_id=6c469af6-74d0-4fe7-bf37-c97adbe6c5db)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Creating volume be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:18:03 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:03 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 1073741824
Nov 06 08:18:03 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:03 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 1073741824" returned: 0 in 0.566s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:03 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4
Nov 06 08:18:03 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:04 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4" returned: 0 in 0.316s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d95c74-7a55-46ef-bed6-002de76976d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be19e623-17b7-4e5b-8a49-904248459ab4', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fcce8a1-6256-461a-a82d-052af14781a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:04 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Volume volume-be19e623-17b7-4e5b-8a49-904248459ab4 (be19e623-17b7-4e5b-8a49-904248459ab4): created successfully
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fcce8a1-6256-461a-a82d-052af14781a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Flow 'volume_create_manager' (8a0a07ca-68cc-478a-9486-bb4facce69b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:18:04 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f977ed0a-4c8e-4a60-b3c7-e487442124da tempest-GroupSnapshotsV319Test-405251429 None] Created volume successfully.
Nov 06 08:18:04 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] GroupSnapshot 08d16a2d-4c10-4269-8e73-035742d830a5: creating.
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Group snapshot 08d16a2d-4c10-4269-8e73-035742d830a5: creating. {{(pid=87143) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Creating offline snapshot 8f103781-5f29-4ec9-88ee-8e6ebfbf523f of volume be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15be287-0f86-4bdb-aaf0-6d0d51b5b605]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:18:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:04 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4
Nov 06 08:18:04 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:05 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4" returned: 0 in 0.433s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:05 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f 1G
Nov 06 08:18:05 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:05 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f 1G" returned: 0 in 0.488s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be19e623-17b7-4e5b-8a49-904248459ab4 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:05 devstack sudo[88969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be19e623-17b7-4e5b-8a49-904248459ab4 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f
Nov 06 08:18:05 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:06 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be19e623-17b7-4e5b-8a49-904248459ab4 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f" returned: 0 in 0.365s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:06 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:18:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:06 devstack sudo[88974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f
Nov 06 08:18:06 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:06 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f" returned: 0 in 0.316s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:06 devstack sudo[88977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.info
Nov 06 08:18:06 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:06 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.info" returned: 0 in 0.279s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:06 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:18:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:06 devstack sudo[88980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.info
Nov 06 08:18:06 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:07 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.info" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9a3cba01-2ef9-43dc-8b95-61dbcf6f9c64 tempest-GroupSnapshotsV319Test-405251429 None] group_snapshot 08d16a2d-4c10-4269-8e73-035742d830a5: created successfully
Nov 06 08:18:08 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] group_snapshot 08d16a2d-4c10-4269-8e73-035742d830a5: deleting
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] group_snapshot 08d16a2d-4c10-4269-8e73-035742d830a5: deleting {{(pid=87143) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Acquiring lock "cinder-quobyte-be19e623-17b7-4e5b-8a49-904248459ab4" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Lock "cinder-quobyte-be19e623-17b7-4e5b-8a49-904248459ab4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Acquiring lock "cinder-quobyte-8f103781-5f29-4ec9-88ee-8e6ebfbf523f" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Lock "cinder-quobyte-8f103781-5f29-4ec9-88ee-8e6ebfbf523f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Deleting offline snapshot 8f103781-5f29-4ec9-88ee-8e6ebfbf523f of volume be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] snapshot_file for this snap is: volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3a4db-cdef-40be-9079-3a9b511a75e1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:18:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:08 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f
Nov 06 08:18:08 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:09 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f" returned: 0 in 0.453s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be19e623-17b7-4e5b-8a49-904248459ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:18:09 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9d0703-4321-40af-ab87-35ea1a21a31a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:18:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:09 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4
Nov 06 08:18:09 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:09 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:09 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f
Nov 06 08:18:09 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:10 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f" returned: 0 in 0.525s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:10 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f
Nov 06 08:18:10 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:10 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4.8f103781-5f29-4ec9-88ee-8e6ebfbf523f" returned: 0 in 0.310s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Lock "cinder-quobyte-8f103781-5f29-4ec9-88ee-8e6ebfbf523f" released by "_delete_snapshot" :: held 1.864s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:18:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Lock "cinder-quobyte-be19e623-17b7-4e5b-8a49-904248459ab4" released by "delete_snapshot" :: held 1.909s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:18:10 devstack cinder-volume[87143]: WARNING cinder.quota [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-748441183 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-748441183, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:18:10 devstack cinder-volume[87143]: WARNING cinder.quota [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-748441183 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-748441183, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:18:10 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] Created reservations ['ea598df8-2514-474e-986f-0caa203d3803', '915b47c0-084f-4e81-9abb-7b61c78cb193', '35be2a8a-6fcb-47d7-b05d-c0fdfcca6845', 'd0644473-8270-401d-92cd-2f326e883fad'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:18:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d57f19ab-724d-47a1-8e25-3cc4a7c23c22 tempest-GroupSnapshotsV319Test-405251429 None] group_snapshot 08d16a2d-4c10-4269-8e73-035742d830a5: deleted successfully
Nov 06 08:18:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Acquiring lock "cinder-quobyte-be19e623-17b7-4e5b-8a49-904248459ab4" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:18:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Lock "cinder-quobyte-be19e623-17b7-4e5b-8a49-904248459ab4" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:18:11 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581ff39-d4f4-4b31-813f-d4b616b03010]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:18:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:11 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4
Nov 06 08:18:11 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:11 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4" returned: 0 in 0.517s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:11 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4
Nov 06 08:18:11 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:12 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-be19e623-17b7-4e5b-8a49-904248459ab4" returned: 0 in 0.353s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Lock "cinder-quobyte-be19e623-17b7-4e5b-8a49-904248459ab4" released by "delete_volume" :: held 0.970s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Created reservations ['a300af97-7414-49e9-be29-6d882fc3e37d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:18:12 devstack cinder-volume[87143]: WARNING cinder.quota [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-748441183 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-748441183, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Created reservations ['0fbfcab1-bb86-4cb3-98bc-a339c1f0885a', 'cda4b312-fccf-44e4-bf0c-142aaaab7315', '27d3e003-7848-4c02-a7c4-a4aa6f4b0cce', '5df6c302-4ff1-4ad3-bf1b-a088ca1bd95e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:12 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:18:12 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:13 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.359s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:13 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:18:13 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2bf7add3-f610-415a-a4b2-be07628f1f25 tempest-GroupSnapshotsV319Test-405251429 None] Delete group completed successfully.
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Flow 'volume_create_manager' (4bc63f0d-8c8a-4dbd-a57f-9218b1bb0419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6aa686-371e-4c06-ac7b-5788a0cd4db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6aa686-371e-4c06-ac7b-5788a0cd4db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-154070664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049e4f42-781d-4a92-94db-bb8f1535560e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd69e0e0343c478a9ce79cd88a33414e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:18:15Z,use_quota=True,user_id='acfec321b64341bc8252456e48f73cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f09207-158c-41a2-9366-775373372cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f09207-158c-41a2-9366-775373372cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc5f8c4-25d7-439e-824a-df9958e284b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc5f8c4-25d7-439e-824a-df9958e284b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049e4f42-781d-4a92-94db-bb8f1535560e', 'volume_name': 'volume-049e4f42-781d-4a92-94db-bb8f1535560e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970bb03a-6f05-4428-9d36-1ba6f5d161f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970bb03a-6f05-4428-9d36-1ba6f5d161f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da8fbc8-0d09-4b6d-a68e-bfd9bcf49dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Volume 049e4f42-781d-4a92-94db-bb8f1535560e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049e4f42-781d-4a92-94db-bb8f1535560e', 'volume_size': 1}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-154070664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049e4f42-781d-4a92-94db-bb8f1535560e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd69e0e0343c478a9ce79cd88a33414e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:18:15Z,use_quota=True,user_id='acfec321b64341bc8252456e48f73cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Creating volume 049e4f42-781d-4a92-94db-bb8f1535560e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:18:14 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:18:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:14 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e 1073741824
Nov 06 08:18:14 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:15 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e 1073741824" returned: 0 in 0.575s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:15 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e
Nov 06 08:18:15 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:15 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e" returned: 0 in 0.297s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da8fbc8-0d09-4b6d-a68e-bfd9bcf49dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049e4f42-781d-4a92-94db-bb8f1535560e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9d0c18-1c46-4ac1-8b80-433a20a5487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Volume volume-049e4f42-781d-4a92-94db-bb8f1535560e (049e4f42-781d-4a92-94db-bb8f1535560e): created successfully
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9d0c18-1c46-4ac1-8b80-433a20a5487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Flow 'volume_create_manager' (4bc63f0d-8c8a-4dbd-a57f-9218b1bb0419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:18:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-befc0f34-0e31-419d-85ea-7174a060aac5 tempest-TaggedAttachmentsTest-2059709889 None] Created volume successfully.
Nov 06 08:18:25 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:INSERT=6 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:18:25 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=23,cinder:SELECT=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:30 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:18:30 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:30 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.470s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 8 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:18:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:18:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1c66a047-1077-4360-b287-c64e77acc0ee tempest-GroupsV320Test-485836494 None] Group tempest-GroupsV320Test-Group-424330620: creating
Nov 06 08:18:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1c66a047-1077-4360-b287-c64e77acc0ee tempest-GroupsV320Test-485836494 None] Group tempest-GroupsV320Test-Group-424330620: created successfully
Nov 06 08:18:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1c66a047-1077-4360-b287-c64e77acc0ee tempest-GroupsV320Test-485836494 None] Create group completed successfully.
Nov 06 08:18:37 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Created reservations ['c7ea05ab-bb6a-4134-896a-2484a72bf378'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:18:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:18:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:18:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:37 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:18:37 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:38 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.678s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:38 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:18:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b63ff726-617a-4cf5-b8d8-7e3a215191a4 tempest-GroupsV320Test-485836494 None] Delete group completed successfully.
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Flow 'volume_create_manager' (b2763388-4d3f-480d-aa2d-447ec20dd321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc1d1a3-b96e-4cb1-a2ba-bfb7410c5ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc1d1a3-b96e-4cb1-a2ba-bfb7410c5ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-283942964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8aefe4-743e-4261-ab71-86d67626c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e337edb40ee43c1ad02a36ae56161b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:18:47Z,use_quota=True,user_id='957a20283c3840fcaef5d113424193dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb59499e-c236-4914-a19c-8d7c19c7799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb59499e-c236-4914-a19c-8d7c19c7799c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d87924-f2ea-4b6c-a666-912647b33124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d87924-f2ea-4b6c-a666-912647b33124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8aefe4-743e-4261-ab71-86d67626c715', 'volume_name': 'volume-0d8aefe4-743e-4261-ab71-86d67626c715', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56850d7b-d3fd-46c2-905c-97e456a659ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56850d7b-d3fd-46c2-905c-97e456a659ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c846564-868e-4655-8684-75b30648f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:47 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Volume 0d8aefe4-743e-4261-ab71-86d67626c715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8aefe4-743e-4261-ab71-86d67626c715', 'volume_size': 1}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-283942964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8aefe4-743e-4261-ab71-86d67626c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e337edb40ee43c1ad02a36ae56161b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:18:47Z,use_quota=True,user_id='957a20283c3840fcaef5d113424193dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Creating volume 0d8aefe4-743e-4261-ab71-86d67626c715 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:18:47 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:18:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:47 devstack sudo[89361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715 1073741824
Nov 06 08:18:47 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:48 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715 1073741824" returned: 0 in 1.046s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:18:48 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715
Nov 06 08:18:48 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:18:49 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Nov 06 08:18:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715" returned: 0 in 0.709s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:18:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:18:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:18:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c846564-868e-4655-8684-75b30648f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8aefe4-743e-4261-ab71-86d67626c715', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0a7ca5-216f-4f53-9655-905401ca5022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:18:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Volume volume-0d8aefe4-743e-4261-ab71-86d67626c715 (0d8aefe4-743e-4261-ab71-86d67626c715): created successfully
Nov 06 08:18:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0a7ca5-216f-4f53-9655-905401ca5022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:18:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Flow 'volume_create_manager' (b2763388-4d3f-480d-aa2d-447ec20dd321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:18:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ab1acb5d-6153-4223-9259-f1f6044bd53f tempest-ServerActionsTestOtherA-502115592 None] Created volume successfully.
Nov 06 08:18:59 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:18:59 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Flow 'volume_create_manager' (8ab9f8c0-cce9-4729-beed-6d014e67e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac18e7d-af6f-4c1d-b027-d9a0dda5d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac18e7d-af6f-4c1d-b027-d9a0dda5d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1905311968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d7e381-50dc-49f9-9dba-7ba69d3996f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a033e5de0cfa4671a99b249afc51e5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:03Z,use_quota=True,user_id='3d452b53e16e4291b07dc6dfda9279cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84750ea8-a041-4d01-aa8b-8def2c013e16),volume_type_id=84750ea8-a041-4d01-aa8b-8def2c013e16)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63233262-86aa-427e-80c9-c77cfcf9a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63233262-86aa-427e-80c9-c77cfcf9a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b6bb24-043b-4b5c-bff8-3f575dfe481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b6bb24-043b-4b5c-bff8-3f575dfe481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d7e381-50dc-49f9-9dba-7ba69d3996f1', 'volume_name': 'volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e42f1f-36f5-4008-8c70-1f5ff426c23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e42f1f-36f5-4008-8c70-1f5ff426c23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33adbddd-2036-48a3-9e0e-afe239865a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:03 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Volume 29d7e381-50dc-49f9-9dba-7ba69d3996f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1', 'volume_size': 1}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1905311968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d7e381-50dc-49f9-9dba-7ba69d3996f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a033e5de0cfa4671a99b249afc51e5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:03Z,use_quota=True,user_id='3d452b53e16e4291b07dc6dfda9279cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84750ea8-a041-4d01-aa8b-8def2c013e16),volume_type_id=84750ea8-a041-4d01-aa8b-8def2c013e16)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Creating volume 29d7e381-50dc-49f9-9dba-7ba69d3996f1 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:03 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:03 devstack sudo[89634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1 1073741824
Nov 06 08:19:03 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Flow 'volume_create_manager' (cd06d0b0-1533-40df-bc7f-737655dd578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7248ee9d-6a7a-4b60-adec-e8b5b2bdce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7248ee9d-6a7a-4b60-adec-e8b5b2bdce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1698087822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9437016f9f034cfd99c0589cff1b1a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:04Z,use_quota=True,user_id='cd6a9b3f059a424ebdb9b67bf6d9f91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:04 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c98455-ee1e-4900-85cf-71b49b336962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c98455-ee1e-4900-85cf-71b49b336962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f1250d-adfb-480d-b22f-fdb93352ad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f1250d-adfb-480d-b22f-fdb93352ad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b', 'volume_name': 'volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb22db1-72db-4d41-8cdf-dd2fd4ec9291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb22db1-72db-4d41-8cdf-dd2fd4ec9291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c326044f-e170-42b2-84d9-33ac7619ecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:04 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Volume 5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b', 'volume_size': 1}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1 1073741824" returned: 0 in 1.178s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:04 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1
Nov 06 08:19:04 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:05 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1" returned: 0 in 0.650s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1698087822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9437016f9f034cfd99c0589cff1b1a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:04Z,use_quota=True,user_id='cd6a9b3f059a424ebdb9b67bf6d9f91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Creating volume 5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:05 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33adbddd-2036-48a3-9e0e-afe239865a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3837a13-a2dd-4775-ab92-82bef246d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:05 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b 1073741824
Nov 06 08:19:05 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:05 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Volume volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1 (29d7e381-50dc-49f9-9dba-7ba69d3996f1): created successfully
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3837a13-a2dd-4775-ab92-82bef246d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Flow 'volume_create_manager' (8ab9f8c0-cce9-4729-beed-6d014e67e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c1cf4e23-c9c9-46c6-9c9b-f7d456d2ce66 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Created volume successfully.
Nov 06 08:19:06 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b 1073741824" returned: 0 in 0.725s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:06 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b
Nov 06 08:19:06 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:06 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b" returned: 0 in 0.552s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c326044f-e170-42b2-84d9-33ac7619ecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c6c43e-9f8e-4fd3-856a-7dc73150c48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:06 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Volume volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b (5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b): created successfully
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c6c43e-9f8e-4fd3-856a-7dc73150c48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Flow 'volume_create_manager' (cd06d0b0-1533-40df-bc7f-737655dd578a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:06 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6276c8a0-2895-46ef-8af7-6307541c794a tempest-ServersNegativeTestJSON-953521736 None] Created volume successfully.
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:07 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:07 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:07 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.336s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:07 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7f3d0e9b-2a3a-4381-b42b-23a6783d1da7 tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Retype volume completed successfully.
Nov 06 08:19:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Acquiring lock "cinder-29d7e381-50dc-49f9-9dba-7ba69d3996f1-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "cinder-29d7e381-50dc-49f9-9dba-7ba69d3996f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Acquiring lock "cinder-quobyte-29d7e381-50dc-49f9-9dba-7ba69d3996f1" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "cinder-quobyte-29d7e381-50dc-49f9-9dba-7ba69d3996f1" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:08 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091495d-810f-4323-9c2c-f15e15d416cc]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:09 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1
Nov 06 08:19:09 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:09 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1" returned: 0 in 0.488s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:09 devstack sudo[89679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1
Nov 06 08:19:09 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:09 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29d7e381-50dc-49f9-9dba-7ba69d3996f1" returned: 0 in 0.336s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "cinder-quobyte-29d7e381-50dc-49f9-9dba-7ba69d3996f1" released by "delete_volume" :: held 0.882s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:09 devstack cinder-volume[87143]: WARNING cinder.quota [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:19:09 devstack cinder-volume[87143]: WARNING cinder.quota [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Created reservations ['e36169f1-c259-4a35-bae9-6e5b42acac49', '62a8a7b7-1f23-43c9-a68e-2e784bafb35e', '49ec5471-d847-46c7-9d4b-623603f3b3f5', '211acfe3-68ba-4872-95f9-f885d471a6bc'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:10 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:10 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:10 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.780s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:10 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Deleted volume successfully.
Nov 06 08:19:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-68716beb-128e-4eb9-ae38-0124fde1a05d tempest-VolumeRetypeWithoutMigrationTest-1594503956 None] Lock "cinder-29d7e381-50dc-49f9-9dba-7ba69d3996f1-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:11 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Flow 'volume_create_manager' (98c4440a-7921-4c2d-b91b-e226455e5f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460b8bed-f683-4571-bec7-94dab3fad535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460b8bed-f683-4571-bec7-94dab3fad535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2083314181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83351e4-cdd0-4941-b062-9f72983d3932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9437016f9f034cfd99c0589cff1b1a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:12Z,use_quota=True,user_id='cd6a9b3f059a424ebdb9b67bf6d9f91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96f78b2-d292-4663-bd2c-b8f2a7bbcfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96f78b2-d292-4663-bd2c-b8f2a7bbcfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e8d15-1409-4aaf-8247-71f6eff99383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e8d15-1409-4aaf-8247-71f6eff99383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83351e4-cdd0-4941-b062-9f72983d3932', 'volume_name': 'volume-f83351e4-cdd0-4941-b062-9f72983d3932', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c72ee-f6d1-4c3b-bc72-668440fcc761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c72ee-f6d1-4c3b-bc72-668440fcc761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39afde50-a559-4d82-a928-655492989944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Volume f83351e4-cdd0-4941-b062-9f72983d3932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83351e4-cdd0-4941-b062-9f72983d3932', 'volume_size': 1}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2083314181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83351e4-cdd0-4941-b062-9f72983d3932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9437016f9f034cfd99c0589cff1b1a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:12Z,use_quota=True,user_id='cd6a9b3f059a424ebdb9b67bf6d9f91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Creating volume f83351e4-cdd0-4941-b062-9f72983d3932 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:12 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:12 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932 1073741824
Nov 06 08:19:12 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:13 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932 1073741824" returned: 0 in 1.080s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:13 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932
Nov 06 08:19:13 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:13 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932" returned: 0 in 0.486s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39afde50-a559-4d82-a928-655492989944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83351e4-cdd0-4941-b062-9f72983d3932', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75f1be2-8340-4d6d-9f08-fd729634b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:13 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Volume volume-f83351e4-cdd0-4941-b062-9f72983d3932 (f83351e4-cdd0-4941-b062-9f72983d3932): created successfully
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75f1be2-8340-4d6d-9f08-fd729634b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Flow 'volume_create_manager' (98c4440a-7921-4c2d-b91b-e226455e5f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:13 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-99d6a46b-f03b-4abe-8d0e-8b863a90e1c1 tempest-ServersNegativeTestJSON-953521736 None] Created volume successfully.
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-5de7fa8e-526b-4f0c-8899-29a16552656b req-f52738f4-907f-4558-8933-83ce6f570726 tempest-TaggedAttachmentsTest-2059709889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-5de7fa8e-526b-4f0c-8899-29a16552656b req-f52738f4-907f-4558-8933-83ce6f570726 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-5de7fa8e-526b-4f0c-8899-29a16552656b req-f52738f4-907f-4558-8933-83ce6f570726 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-5de7fa8e-526b-4f0c-8899-29a16552656b req-f52738f4-907f-4558-8933-83ce6f570726 tempest-TaggedAttachmentsTest-2059709889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-049e4f42-781d-4a92-94db-bb8f1535560e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db8e9b77-5beb-446e-8f9a-efebeca2ec95', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:19:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-5de7fa8e-526b-4f0c-8899-29a16552656b req-f52738f4-907f-4558-8933-83ce6f570726 tempest-TaggedAttachmentsTest-2059709889 None] attachment_update completed successfully.
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "cinder-f83351e4-cdd0-4941-b062-9f72983d3932-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-f83351e4-cdd0-4941-b062-9f72983d3932-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "cinder-quobyte-f83351e4-cdd0-4941-b062-9f72983d3932" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-quobyte-f83351e4-cdd0-4941-b062-9f72983d3932" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eded7b2-6489-4af9-835a-088520ba6d00]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:15 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932
Nov 06 08:19:15 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:15 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932" returned: 0 in 0.491s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:16 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932
Nov 06 08:19:16 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:16 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f83351e4-cdd0-4941-b062-9f72983d3932" returned: 0 in 0.366s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-quobyte-f83351e4-cdd0-4941-b062-9f72983d3932" released by "delete_volume" :: held 0.934s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Created reservations ['2eae4505-e4a8-453e-8572-e2280edc87f7', 'a2a0fad4-8689-4929-b9c2-845612798b25', 'd79f0e70-0ad5-424d-a64c-712bdd96465b', '670f49c8-36fa-4eb4-bd56-1283383fb3f1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:16 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:16 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:16 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.321s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:16 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Deleted volume successfully.
Nov 06 08:19:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2946e9c5-e154-4b32-bd33-dfe8f612cd91 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-f83351e4-cdd0-4941-b062-9f72983d3932-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "cinder-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "cinder-quobyte-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-quobyte-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaca087-b7eb-47ae-a187-effa164c5042]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:18 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b
Nov 06 08:19:18 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:18 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b" returned: 0 in 0.629s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:18 devstack sudo[90263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b
Nov 06 08:19:18 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:18 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b" returned: 0 in 0.280s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-quobyte-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b" released by "delete_volume" :: held 0.983s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Created reservations ['db20be23-0dee-40c4-8e0b-ee4cac456658', '3a4f3036-82e1-4965-88b3-5f4b33353b9d', 'f3c00bf0-e66c-4af0-b3b1-8628015542a6', '06d5bc14-dea0-482f-9004-b3d34bb3de24'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:19 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:19 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:19 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.279s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:19 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Deleted volume successfully.
Nov 06 08:19:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-689b78ec-6d79-48a5-9b6e-3e65447999b1 tempest-ServersNegativeTestJSON-953521736 None] Lock "cinder-5ce5f7ae-39cf-4ecf-a47b-cabb30b99c1b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-fb91a850-883b-4ab2-99be-8efc78c9e45e req-1b87599f-89fd-4864-8182-6984213f4ec6 tempest-TaggedAttachmentsTest-2059709889 None] Terminate volume connection completed successfully.
Nov 06 08:19:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fb91a850-883b-4ab2-99be-8efc78c9e45e req-1b87599f-89fd-4864-8182-6984213f4ec6 tempest-TaggedAttachmentsTest-2059709889 None] Deleting attachment db8e9b77-5beb-446e-8f9a-efebeca2ec95. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Flow 'volume_create_manager' (18301556-252f-4c60-909c-0fe7fbae2bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc0b3cc-1943-4a30-ba53-6259af2367da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc0b3cc-1943-4a30-ba53-6259af2367da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1813714027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b78fe-9dd6-4c6a-942d-cfe157264068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f712efbe0354f25acd15e5ac268ccf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:21Z,use_quota=True,user_id='5a4dd475e5ab4a7698f59f7a5c93e527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0776f59-642b-4cd1-a8c0-b2a07e250c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0776f59-642b-4cd1-a8c0-b2a07e250c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2699b01-7b36-4418-ac6d-5fb9a8e57bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2699b01-7b36-4418-ac6d-5fb9a8e57bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081b78fe-9dd6-4c6a-942d-cfe157264068', 'volume_name': 'volume-081b78fe-9dd6-4c6a-942d-cfe157264068', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39ea549-743b-4aad-baa4-cb033d207938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39ea549-743b-4aad-baa4-cb033d207938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4f4211-53c8-4bb3-a587-9d9c0ff6e3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:21 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Volume 081b78fe-9dd6-4c6a-942d-cfe157264068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081b78fe-9dd6-4c6a-942d-cfe157264068', 'volume_size': 1}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1813714027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b78fe-9dd6-4c6a-942d-cfe157264068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f712efbe0354f25acd15e5ac268ccf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:21Z,use_quota=True,user_id='5a4dd475e5ab4a7698f59f7a5c93e527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Creating volume 081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:21 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:21 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 1073741824
Nov 06 08:19:21 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:21 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 1073741824" returned: 0 in 0.517s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:21 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068
Nov 06 08:19:21 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:22 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068" returned: 0 in 0.398s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4f4211-53c8-4bb3-a587-9d9c0ff6e3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081b78fe-9dd6-4c6a-942d-cfe157264068', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31881570-d4d6-4d97-9dab-65cb1b65c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:22 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Volume volume-081b78fe-9dd6-4c6a-942d-cfe157264068 (081b78fe-9dd6-4c6a-942d-cfe157264068): created successfully
Nov 06 08:19:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31881570-d4d6-4d97-9dab-65cb1b65c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Flow 'volume_create_manager' (18301556-252f-4c60-909c-0fe7fbae2bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b675cc5a-5d65-49c2-a70a-f584fb48959e tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Created volume successfully.
Nov 06 08:19:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Creating offline snapshot 50a7688e-6664-4154-a05b-3c3115968ec1 of volume 081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:19:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03377ff-2207-4ece-895f-016c877ffa8c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:23 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068
Nov 06 08:19:23 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:23 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068" returned: 0 in 0.363s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:23 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 1G
Nov 06 08:19:23 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:24 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 1G" returned: 0 in 0.493s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081b78fe-9dd6-4c6a-942d-cfe157264068 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:24 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081b78fe-9dd6-4c6a-942d-cfe157264068 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1
Nov 06 08:19:24 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:24 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081b78fe-9dd6-4c6a-942d-cfe157264068 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1" returned: 0 in 0.373s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:24 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 is being set with open permissions: ugo+rw
Nov 06 08:19:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:24 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1
Nov 06 08:19:24 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:25 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1" returned: 0 in 0.432s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:25 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.info
Nov 06 08:19:25 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:25 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.info" returned: 0 in 0.528s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:25 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.info is being set with open permissions: ugo+rw
Nov 06 08:19:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:25 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.info
Nov 06 08:19:25 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:26 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.info" returned: 0 in 0.342s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cd7002b5-3978-4cf6-8437-902771f32e3b tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Create snapshot completed successfully
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "cinder-50a7688e-6664-4154-a05b-3c3115968ec1-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-50a7688e-6664-4154-a05b-3c3115968ec1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "cinder-quobyte-081b78fe-9dd6-4c6a-942d-cfe157264068" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-quobyte-081b78fe-9dd6-4c6a-942d-cfe157264068" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "cinder-quobyte-50a7688e-6664-4154-a05b-3c3115968ec1" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-quobyte-50a7688e-6664-4154-a05b-3c3115968ec1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Deleting offline snapshot 50a7688e-6664-4154-a05b-3c3115968ec1 of volume 081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] snapshot_file for this snap is: volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[327c6be2-327a-404d-b28c-13527e73de37]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:27 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1
Nov 06 08:19:27 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:27 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1" returned: 0 in 0.511s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-081b78fe-9dd6-4c6a-942d-cfe157264068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e6ccda-772c-4074-8ced-536779afbe68]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:28 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068
Nov 06 08:19:28 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:28 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068" returned: 0 in 0.471s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:28 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1
Nov 06 08:19:28 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:28 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1" returned: 0 in 0.413s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:28 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1
Nov 06 08:19:28 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:29 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068.50a7688e-6664-4154-a05b-3c3115968ec1" returned: 0 in 0.293s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-quobyte-50a7688e-6664-4154-a05b-3c3115968ec1" released by "_delete_snapshot" :: held 1.839s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-quobyte-081b78fe-9dd6-4c6a-942d-cfe157264068" released by "delete_snapshot" :: held 1.871s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Created reservations ['ccee3674-1ac8-49dc-8e46-4d8a64dca2bc', '983d37fb-0f25-4443-85bd-a50801bab93a', '6384d5de-0de6-4371-870c-fe7d829d7800', '766e5f91-657f-40ef-a581-a1b84769f769'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Delete snapshot completed successfully.
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15dc422a-d31e-4ad6-be2b-ce74dbaf4db9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-50a7688e-6664-4154-a05b-3c3115968ec1-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "cinder-081b78fe-9dd6-4c6a-942d-cfe157264068-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-081b78fe-9dd6-4c6a-942d-cfe157264068-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "cinder-quobyte-081b78fe-9dd6-4c6a-942d-cfe157264068" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-quobyte-081b78fe-9dd6-4c6a-942d-cfe157264068" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9169275d-edb5-4ede-ba15-5de33196d717]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:29 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068
Nov 06 08:19:29 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:30 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068" returned: 0 in 0.488s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:30 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068
Nov 06 08:19:30 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:30 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:30 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-d761f56c-7887-4414-b768-4808be8e1825 req-9274bfe4-d250-42b4-8f00-7303518b1fe4 tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-d761f56c-7887-4414-b768-4808be8e1825 req-9274bfe4-d250-42b4-8f00-7303518b1fe4 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-d761f56c-7887-4414-b768-4808be8e1825 req-9274bfe4-d250-42b4-8f00-7303518b1fe4 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-d761f56c-7887-4414-b768-4808be8e1825 req-9274bfe4-d250-42b4-8f00-7303518b1fe4 tempest-ServerActionsTestOtherA-502115592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-0d8aefe4-743e-4261-ab71-86d67626c715', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a874affb-e336-4c68-a2e7-6788bf08b03e', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:19:30 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-d761f56c-7887-4414-b768-4808be8e1825 req-9274bfe4-d250-42b4-8f00-7303518b1fe4 tempest-ServerActionsTestOtherA-502115592 None] attachment_update completed successfully.
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.308s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:30 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-081b78fe-9dd6-4c6a-942d-cfe157264068" returned: 0 in 0.530s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-quobyte-081b78fe-9dd6-4c6a-942d-cfe157264068" released by "delete_volume" :: held 1.130s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Created reservations ['f63481f8-c9fd-4b38-8b6b-0337440a3d48', 'd9ddf7ed-694f-4a03-af40-10d978e853f9', '570ca8d1-024d-490b-a99e-01992aa8901e', 'e6a739b5-0a20-48a8-a0fc-2150ed30be09'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:31 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:31 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Acquiring lock "cinder-049e4f42-781d-4a92-94db-bb8f1535560e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:31 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.337s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:31 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Deleted volume successfully.
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Lock "cinder-049e4f42-781d-4a92-94db-bb8f1535560e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3bc10192-f9f2-40ce-87b5-ffc5ed9b5523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1336999209 None] Lock "cinder-081b78fe-9dd6-4c6a-942d-cfe157264068-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Acquiring lock "cinder-quobyte-049e4f42-781d-4a92-94db-bb8f1535560e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Lock "cinder-quobyte-049e4f42-781d-4a92-94db-bb8f1535560e" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaeee16-95c4-4741-9632-c771b2220b07]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:31 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e
Nov 06 08:19:31 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:31 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e" returned: 0 in 0.469s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:31 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e
Nov 06 08:19:31 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:32 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-049e4f42-781d-4a92-94db-bb8f1535560e" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Lock "cinder-quobyte-049e4f42-781d-4a92-94db-bb8f1535560e" released by "delete_volume" :: held 0.792s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Created reservations ['46a5d382-d7cd-4ceb-818c-ac09836d68b8', '16ca7e9e-5a16-4d0f-bfcb-8b08f287da6a', 'a7f01159-9b39-441b-8209-71c9332fbc7e', '6c8b818c-427d-462b-9291-e22f8820721d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:32 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:32 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:32 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.393s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:32 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Deleted volume successfully.
Nov 06 08:19:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f8f2bca5-edfe-4496-9796-bcfbad9a43a8 tempest-TaggedAttachmentsTest-2059709889 None] Lock "cinder-049e4f42-781d-4a92-94db-bb8f1535560e-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Flow 'volume_create_manager' (60eae23a-0053-44b0-8e72-7bf9b13bc216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97ea317-6c17-4861-ad81-88cb195668b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97ea317-6c17-4861-ad81-88cb195668b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1580508344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c09cfd9e0dc4d0f8d0e9fda4c44981a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:34Z,use_quota=True,user_id='fc5c4f17230f4fd88ea6804e16c936f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b165fd-b824-4ed0-83b8-9ef46f588c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b165fd-b824-4ed0-83b8-9ef46f588c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a134353a-c583-4967-8565-4fc67a71f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a134353a-c583-4967-8565-4fc67a71f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce', 'volume_name': 'volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e25284-064f-4b35-8049-ba7dd0462f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e25284-064f-4b35-8049-ba7dd0462f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d2c3a8-7aff-4cec-9ff1-5b2264d81fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:33 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Volume b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce', 'volume_size': 1}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1580508344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c09cfd9e0dc4d0f8d0e9fda4c44981a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:34Z,use_quota=True,user_id='fc5c4f17230f4fd88ea6804e16c936f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Creating volume b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:33 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:33 devstack sudo[90882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce 1073741824
Nov 06 08:19:33 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:34 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce 1073741824" returned: 0 in 0.645s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:34 devstack sudo[90892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce
Nov 06 08:19:34 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:34 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce" returned: 0 in 0.391s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d2c3a8-7aff-4cec-9ff1-5b2264d81fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17fc332-1dc5-4968-8bf5-0487b0b53227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Volume volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce (b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce): created successfully
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17fc332-1dc5-4968-8bf5-0487b0b53227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Flow 'volume_create_manager' (60eae23a-0053-44b0-8e72-7bf9b13bc216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-f65d2ef3-0695-4c56-be66-bbc794df8501 req-28903e1a-09fd-4301-86eb-aeb0cd7937f7 tempest-VolumesGetTestJSON-788079513 None] Created volume successfully.
Nov 06 08:19:35 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-61a7bd19-ba45-4290-bca5-ce09088fa272 req-b630171a-d375-4aed-85f5-4ec93230e486 tempest-ServerActionsTestOtherA-502115592 None] Terminate volume connection completed successfully.
Nov 06 08:19:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-61a7bd19-ba45-4290-bca5-ce09088fa272 req-b630171a-d375-4aed-85f5-4ec93230e486 tempest-ServerActionsTestOtherA-502115592 None] Deleting attachment a874affb-e336-4c68-a2e7-6788bf08b03e. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:19:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-61a7bd19-ba45-4290-bca5-ce09088fa272 req-828c3f80-cb3d-42b4-ac5c-8236c3682df9 tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-61a7bd19-ba45-4290-bca5-ce09088fa272 req-828c3f80-cb3d-42b4-ac5c-8236c3682df9 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-61a7bd19-ba45-4290-bca5-ce09088fa272 req-828c3f80-cb3d-42b4-ac5c-8236c3682df9 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-61a7bd19-ba45-4290-bca5-ce09088fa272 req-828c3f80-cb3d-42b4-ac5c-8236c3682df9 tempest-ServerActionsTestOtherA-502115592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-0d8aefe4-743e-4261-ab71-86d67626c715', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '595d142e-b700-4f65-b75a-af0b1e275989', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:19:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-61a7bd19-ba45-4290-bca5-ce09088fa272 req-828c3f80-cb3d-42b4-ac5c-8236c3682df9 tempest-ServerActionsTestOtherA-502115592 None] attachment_update completed successfully.
Nov 06 08:19:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Acquiring lock "cinder-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Lock "cinder-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Acquiring lock "cinder-quobyte-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Lock "cinder-quobyte-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:37 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f1d7c6-a527-4a28-afdb-58c0f8d2eae3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:37 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce
Nov 06 08:19:37 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:37 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce" returned: 0 in 0.501s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:37 devstack sudo[90974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce
Nov 06 08:19:37 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:37 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce" returned: 0 in 0.416s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Lock "cinder-quobyte-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce" released by "delete_volume" :: held 0.980s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG cinder.quota [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Created reservations ['9a66e3e5-48f2-4f5c-ab20-cc486f20f3ee', '353d45d4-bcb7-4089-b26e-0495d7e2f318', '89ca3de8-2726-4646-bc50-dfcde9796050', 'c5ede486-41a4-41b4-9669-db6ae5405994'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:38 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:38 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:38 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.651s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG cinder.manager [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Deleted volume successfully.
Nov 06 08:19:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-e0cd7792-243b-4b15-b816-ef803d5c1b96 req-bfbb0fd2-1c10-4ce3-b0d5-c4f5af74bdc0 tempest-VolumesGetTestJSON-788079513 None] Lock "cinder-b4d5de2b-bfe2-4a78-8940-bdbdc7e458ce-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Flow 'volume_create_manager' (dc63386c-f57f-419a-8a81-dc1bafaf2a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e673dc7-ebbe-4859-89b2-6a20c6a06b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e673dc7-ebbe-4859-89b2-6a20c6a06b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952206521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d936a69f-8c06-4af0-8cee-7f628ddc89c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcc5a2452564e6da534a8807c8eff18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:42Z,use_quota=True,user_id='731e5b5e21214b94aa76f5785c143b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73749216-20d8-4901-bc79-a5899ebce191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73749216-20d8-4901-bc79-a5899ebce191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f35c51-ca4e-4da1-a7e8-01dfc60a20e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f35c51-ca4e-4da1-a7e8-01dfc60a20e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd936a69f-8c06-4af0-8cee-7f628ddc89c9', 'volume_name': 'volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573e991a-f083-43c4-8999-de7daaad8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573e991a-f083-43c4-8999-de7daaad8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3424795-89f1-4427-b725-b2a1584952ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:42 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Volume d936a69f-8c06-4af0-8cee-7f628ddc89c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9', 'volume_size': 1}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952206521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d936a69f-8c06-4af0-8cee-7f628ddc89c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcc5a2452564e6da534a8807c8eff18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:42Z,use_quota=True,user_id='731e5b5e21214b94aa76f5785c143b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Creating volume d936a69f-8c06-4af0-8cee-7f628ddc89c9 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:42 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:42 devstack sudo[91443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9 1073741824
Nov 06 08:19:42 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:43 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9 1073741824" returned: 0 in 0.873s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:43 devstack sudo[91453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9
Nov 06 08:19:43 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:44 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9" returned: 0 in 0.581s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3424795-89f1-4427-b725-b2a1584952ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95276d11-fb38-47b2-a9b3-fe1f7a2d5396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:44 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Volume volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9 (d936a69f-8c06-4af0-8cee-7f628ddc89c9): created successfully
Nov 06 08:19:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95276d11-fb38-47b2-a9b3-fe1f7a2d5396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Flow 'volume_create_manager' (dc63386c-f57f-419a-8a81-dc1bafaf2a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:44 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-dbf35512-81da-43b5-b378-f6a46f5655bb tempest-VolumesListAdminTestJSON-523892633 None] Created volume successfully.
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Flow 'volume_create_manager' (1229eb5e-7bf9-4693-bf46-0f9a4f164d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c625a90f-e254-4519-8e82-15e14d064227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c625a90f-e254-4519-8e82-15e14d064227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1131508737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b65e47e-c2b0-4a11-90b1-c73b3032bd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcc5a2452564e6da534a8807c8eff18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:45Z,use_quota=True,user_id='731e5b5e21214b94aa76f5785c143b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6891b35d-00ce-4244-9b68-24266781b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6891b35d-00ce-4244-9b68-24266781b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdca6444-5cc4-4a47-80da-710473e16c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdca6444-5cc4-4a47-80da-710473e16c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b65e47e-c2b0-4a11-90b1-c73b3032bd3f', 'volume_name': 'volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be1c744-97b2-4ed1-8fe8-f83778323099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be1c744-97b2-4ed1-8fe8-f83778323099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8577bf6a-47e1-43b8-a11c-f25a79f00525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Volume 3b65e47e-c2b0-4a11-90b1-c73b3032bd3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f', 'volume_size': 1}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1131508737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b65e47e-c2b0-4a11-90b1-c73b3032bd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcc5a2452564e6da534a8807c8eff18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:45Z,use_quota=True,user_id='731e5b5e21214b94aa76f5785c143b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Creating volume 3b65e47e-c2b0-4a11-90b1-c73b3032bd3f {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:45 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:45 devstack sudo[91456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f 1073741824
Nov 06 08:19:45 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:46 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f 1073741824" returned: 0 in 0.479s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:46 devstack sudo[91463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f
Nov 06 08:19:46 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:46 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f" returned: 0 in 0.328s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8577bf6a-47e1-43b8-a11c-f25a79f00525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff60867-8e50-470b-838e-7e24c6736776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Volume volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f (3b65e47e-c2b0-4a11-90b1-c73b3032bd3f): created successfully
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff60867-8e50-470b-838e-7e24c6736776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Flow 'volume_create_manager' (1229eb5e-7bf9-4693-bf46-0f9a4f164d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e43f32fb-a6c6-4fc9-900e-57665fcdc81a tempest-VolumesListAdminTestJSON-523892633 None] Created volume successfully.
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Flow 'volume_create_manager' (0b194d50-65c4-481a-a7b2-e51d809569bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c25b99a-6a85-47e9-a933-15f566d168a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c25b99a-6a85-47e9-a933-15f566d168a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-424846376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e500bd74-bbe1-4572-a932-442b76581b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcc5a2452564e6da534a8807c8eff18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:48Z,use_quota=True,user_id='731e5b5e21214b94aa76f5785c143b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b8d51e-2bf7-423f-b5cc-c7ebfbd84b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b8d51e-2bf7-423f-b5cc-c7ebfbd84b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5301a778-a17c-4797-a3f9-e0f401baada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5301a778-a17c-4797-a3f9-e0f401baada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e500bd74-bbe1-4572-a932-442b76581b33', 'volume_name': 'volume-e500bd74-bbe1-4572-a932-442b76581b33', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003c895a-7de1-451c-9095-388f1cd2d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003c895a-7de1-451c-9095-388f1cd2d966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80471e9d-c049-4c0f-ab60-0613ed52ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Volume e500bd74-bbe1-4572-a932-442b76581b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e500bd74-bbe1-4572-a932-442b76581b33', 'volume_size': 1}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-424846376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e500bd74-bbe1-4572-a932-442b76581b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcc5a2452564e6da534a8807c8eff18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:48Z,use_quota=True,user_id='731e5b5e21214b94aa76f5785c143b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Creating volume e500bd74-bbe1-4572-a932-442b76581b33 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:48 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:48 devstack sudo[91481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33 1073741824
Nov 06 08:19:48 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:49 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33 1073741824" returned: 0 in 0.632s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:49 devstack sudo[91487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33
Nov 06 08:19:49 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:49 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33" returned: 0 in 0.338s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80471e9d-c049-4c0f-ab60-0613ed52ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e500bd74-bbe1-4572-a932-442b76581b33', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef36f416-46cb-4999-a8cb-fed1c64c8806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Volume volume-e500bd74-bbe1-4572-a932-442b76581b33 (e500bd74-bbe1-4572-a932-442b76581b33): created successfully
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef36f416-46cb-4999-a8cb-fed1c64c8806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Flow 'volume_create_manager' (0b194d50-65c4-481a-a7b2-e51d809569bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f89c9602-d3cf-4f82-895b-aa6c330f82ab tempest-VolumesListAdminTestJSON-523892633 None] Created volume successfully.
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Flow 'volume_create_manager' (a29c6765-708e-4e65-a9a1-e616d45fd0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dc621f-8774-4cbe-8e47-8fb67faf32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dc621f-8774-4cbe-8e47-8fb67faf32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27a401b-c127-4cf0-82d9-140a34f8c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ad0a33b8cc44d6a011176ef8605d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:52Z,use_quota=True,user_id='8844cd6d41b246ffa479324464482d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbfe54c-b794-4c1b-bbb8-864d266504e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbfe54c-b794-4c1b-bbb8-864d266504e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63dbf6b-b7b0-4804-96a1-677380ddbbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63dbf6b-b7b0-4804-96a1-677380ddbbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27a401b-c127-4cf0-82d9-140a34f8c1f0', 'volume_name': 'volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f7d891-bb1a-4d72-8b7c-4b88546dd601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f7d891-bb1a-4d72-8b7c-4b88546dd601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5a76c9-8b51-4687-84b3-60b72757784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:51 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Volume e27a401b-c127-4cf0-82d9-140a34f8c1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0', 'volume_size': 1}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27a401b-c127-4cf0-82d9-140a34f8c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ad0a33b8cc44d6a011176ef8605d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:19:52Z,use_quota=True,user_id='8844cd6d41b246ffa479324464482d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Creating volume e27a401b-c127-4cf0-82d9-140a34f8c1f0 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:19:51 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:19:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:51 devstack sudo[91490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0 1073741824
Nov 06 08:19:51 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be047c17-4534-4e37-8bb8-0d7eb801bce1 tempest-BackendsCapabilitiesAdminTestsJSON-557710029 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4119873046875, 'free_capacity_gb': 1773.4119873046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87143) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f86c5add-5ea4-494f-8341-4080b4913cc0 tempest-BackendsCapabilitiesAdminTestsJSON-557710029 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4119873046875, 'free_capacity_gb': 1773.4119873046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87143) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 08:19:52 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0 1073741824" returned: 0 in 0.542s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:52 devstack sudo[91496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0
Nov 06 08:19:52 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:52 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0" returned: 0 in 0.352s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5a76c9-8b51-4687-84b3-60b72757784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847d7bb5-18ad-465e-b6f6-4e4d8a02584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:19:52 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Volume volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0 (e27a401b-c127-4cf0-82d9-140a34f8c1f0): created successfully
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847d7bb5-18ad-465e-b6f6-4e4d8a02584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:19:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Flow 'volume_create_manager' (a29c6765-708e-4e65-a9a1-e616d45fd0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:19:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b166b9fa-d2c6-4b2d-99c3-9a88cd9a29eb tempest-VolumesListAdminTestJSON-718678279 None] Created volume successfully.
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Acquiring lock "cinder-e27a401b-c127-4cf0-82d9-140a34f8c1f0-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Lock "cinder-e27a401b-c127-4cf0-82d9-140a34f8c1f0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Acquiring lock "cinder-quobyte-e27a401b-c127-4cf0-82d9-140a34f8c1f0" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Lock "cinder-quobyte-e27a401b-c127-4cf0-82d9-140a34f8c1f0" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabcdd2e-3cee-41ab-adfb-8a125a2b3de3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "cinder-e500bd74-bbe1-4572-a932-442b76581b33-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-e500bd74-bbe1-4572-a932-442b76581b33-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "cinder-quobyte-e500bd74-bbe1-4572-a932-442b76581b33" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-quobyte-e500bd74-bbe1-4572-a932-442b76581b33" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0aa581-cd09-4f35-9d51-399ec93c5063]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:54 devstack sudo[91521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0
Nov 06 08:19:54 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:54 devstack sudo[91522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33
Nov 06 08:19:54 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:54 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0" returned: 0 in 0.582s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:54 devstack sudo[91532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0
Nov 06 08:19:54 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:54 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33" returned: 0 in 0.490s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:54 devstack sudo[91534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33
Nov 06 08:19:54 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:55 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e27a401b-c127-4cf0-82d9-140a34f8c1f0" returned: 0 in 0.276s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Lock "cinder-quobyte-e27a401b-c127-4cf0-82d9-140a34f8c1f0" released by "delete_volume" :: held 0.928s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Created reservations ['3a55a334-1d6a-49b2-a635-da4e89c0af8a', '69cb72a1-2699-4ead-a367-a83dd3442ed9', 'e5d9cd84-a007-4eba-b93a-dc32535950c5', 'f72301fe-570b-4321-989b-ffcf5e0331ce'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:55 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e500bd74-bbe1-4572-a932-442b76581b33" returned: 0 in 0.356s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-quobyte-e500bd74-bbe1-4572-a932-442b76581b33" released by "delete_volume" :: held 0.905s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:55 devstack sudo[91538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:55 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Created reservations ['3820ebbf-b332-4894-af20-9046c6270bc7', '3c9a9162-2f3e-4a0e-96af-e51860b31423', '2f197693-a6a2-4186-9f33-4f5021d64e3c', 'd7dd0182-ee0f-400a-bd63-f6a2bb597f25'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:55 devstack sudo[91540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:55 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:55 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.437s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Deleted volume successfully.
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-16c43be3-d628-4c7e-acd9-6664ef6e3850 tempest-VolumesListAdminTestJSON-718678279 None] Lock "cinder-e27a401b-c127-4cf0-82d9-140a34f8c1f0-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:55 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.312s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Deleted volume successfully.
Nov 06 08:19:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-97350b59-bd48-4a73-b7ae-9c766cfb9222 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-e500bd74-bbe1-4572-a932-442b76581b33-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "cinder-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "cinder-quobyte-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-quobyte-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:56 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cc29e7-4894-4648-b465-e98e2ed087e5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:56 devstack sudo[91545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f
Nov 06 08:19:56 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:57 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f" returned: 0 in 0.416s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:57 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f
Nov 06 08:19:57 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:57 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f" returned: 0 in 0.303s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-quobyte-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f" released by "delete_volume" :: held 0.779s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Created reservations ['c87344e5-3a6d-4e52-bf6a-3661276b1de2', '68a89641-2124-49e3-8fd1-fd4fc776a66a', '3f0afd4c-ee43-47b2-9d15-e3527680dae1', 'e7650c5b-0972-42d8-9907-c66ac6010b6c'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:57 devstack sudo[91553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:57 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:57 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "cinder-d936a69f-8c06-4af0-8cee-7f628ddc89c9-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.333s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Deleted volume successfully.
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-d936a69f-8c06-4af0-8cee-7f628ddc89c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2817f602-d940-4438-94a3-ed385b296429 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-3b65e47e-c2b0-4a11-90b1-c73b3032bd3f-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "cinder-quobyte-d936a69f-8c06-4af0-8cee-7f628ddc89c9" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:19:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-quobyte-d936a69f-8c06-4af0-8cee-7f628ddc89c9" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf4869e-1912-4db7-9a50-51f5ab075dfe]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:58 devstack sudo[91614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9
Nov 06 08:19:58 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:58 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9" returned: 0 in 0.487s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:58 devstack sudo[91622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9
Nov 06 08:19:58 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:58 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d936a69f-8c06-4af0-8cee-7f628ddc89c9" returned: 0 in 0.294s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-quobyte-d936a69f-8c06-4af0-8cee-7f628ddc89c9" released by "delete_volume" :: held 0.857s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Created reservations ['8140de84-1be8-4421-bf1a-1733513c37da', '16346bcc-07b2-44eb-8076-5eeb9fbad66f', '98cdf403-26fb-43a0-a1e7-81a7773d65f1', 'da2e438f-5b08-4ae8-9bbf-435ccf00f560'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:19:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:19:59 devstack sudo[91625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:19:59 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:19:59 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root
Nov 06 08:19:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.326s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:19:59 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:19:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Deleted volume successfully.
Nov 06 08:19:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6e7a9d26-da66-47cd-a807-4a0559f32117 tempest-VolumesListAdminTestJSON-523892633 None] Lock "cinder-d936a69f-8c06-4af0-8cee-7f628ddc89c9-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:05 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=109,cinder:UPDATE=128,cinder:DELETE=13,cinder:INSERT=21 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:20:05 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=118,cinder:SELECT=104,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:20:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-1f8c8816-aaa8-4bd1-a8f0-0602a66e5d9c req-89c4fb61-6a3d-4396-9c99-dfaf7fec9ba0 tempest-ServerActionsTestOtherA-502115592 None] Terminate volume connection completed successfully.
Nov 06 08:20:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-1f8c8816-aaa8-4bd1-a8f0-0602a66e5d9c req-89c4fb61-6a3d-4396-9c99-dfaf7fec9ba0 tempest-ServerActionsTestOtherA-502115592 None] Deleting attachment 595d142e-b700-4f65-b75a-af0b1e275989. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:20:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6b11a2bd-facb-430b-8474-1fd1d240f00f tempest-GroupsTest-2096046224 None] Group tempest-Group1-412898744: creating
Nov 06 08:20:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6b11a2bd-facb-430b-8474-1fd1d240f00f tempest-GroupsTest-2096046224 None] Group tempest-Group1-412898744: created successfully
Nov 06 08:20:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6b11a2bd-facb-430b-8474-1fd1d240f00f tempest-GroupsTest-2096046224 None] Create group completed successfully.
Nov 06 08:20:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c94d2157-4909-4e17-9bc4-ef7b609f3b23 tempest-GroupsTest-2096046224 None] Group tempest-Group2-583856956: creating
Nov 06 08:20:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c94d2157-4909-4e17-9bc4-ef7b609f3b23 tempest-GroupsTest-2096046224 None] Group tempest-Group2-583856956: created successfully
Nov 06 08:20:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c94d2157-4909-4e17-9bc4-ef7b609f3b23 tempest-GroupsTest-2096046224 None] Create group completed successfully.
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Flow 'volume_create_manager' (ae4fe539-4e61-4f71-8931-a6f30b18cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e441d5-6fe5-441f-b99a-77f96ece82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e441d5-6fe5-441f-b99a-77f96ece82cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004686903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a8c890bb-b9b5-4ad3-9a7c-79908b37f363,host='devstack@QuobyteHD#QuobyteHD',id=d84f5244-e14f-4021-a41f-0d9fd248d14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b70b743911e4ff2ace8e05fdeca95b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:13Z,use_quota=True,user_id='635312bf92ca4a60b179eeffece55a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c83ef435-e38c-4342-aa69-bf3e799ed366),volume_type_id=c83ef435-e38c-4342-aa69-bf3e799ed366)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff25693-fdfa-4dfd-92a7-66f7474f2cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff25693-fdfa-4dfd-92a7-66f7474f2cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1cd33f-a84e-4a3f-af60-06aca0863eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1cd33f-a84e-4a3f-af60-06aca0863eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84f5244-e14f-4021-a41f-0d9fd248d14c', 'volume_name': 'volume-d84f5244-e14f-4021-a41f-0d9fd248d14c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1410b52-ad4e-4aee-836d-77865c67bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1410b52-ad4e-4aee-836d-77865c67bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95ebf69-e279-48eb-9c1b-229e2acea88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Volume d84f5244-e14f-4021-a41f-0d9fd248d14c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84f5244-e14f-4021-a41f-0d9fd248d14c', 'volume_size': 1}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a8c890bb-b9b5-4ad3-9a7c-79908b37f363,created_at=2026-11-06T07:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004686903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a8c890bb-b9b5-4ad3-9a7c-79908b37f363,host='devstack@QuobyteHD#QuobyteHD',id=d84f5244-e14f-4021-a41f-0d9fd248d14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b70b743911e4ff2ace8e05fdeca95b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:13Z,use_quota=True,user_id='635312bf92ca4a60b179eeffece55a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c83ef435-e38c-4342-aa69-bf3e799ed366),volume_type_id=c83ef435-e38c-4342-aa69-bf3e799ed366)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Creating volume d84f5244-e14f-4021-a41f-0d9fd248d14c {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:12 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:12 devstack sudo[91691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c 1073741824
Nov 06 08:20:12 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Flow 'volume_create_manager' (ddeaeee4-27d4-40b6-8653-bb17eccc2545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2ca983-cc6e-4f82-b58e-6ee2b7014a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2ca983-cc6e-4f82-b58e-6ee2b7014a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1294864846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a91a55-3b24-486e-94af-cf24bb9888e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e337edb40ee43c1ad02a36ae56161b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:13Z,use_quota=True,user_id='957a20283c3840fcaef5d113424193dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:13 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d5897f-0920-4b32-9d13-984eedc1b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d5897f-0920-4b32-9d13-984eedc1b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08d7843-e16c-43a7-ad99-d452ccc6c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c 1073741824" returned: 0 in 0.644s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:13 devstack sudo[91697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c
Nov 06 08:20:13 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:13 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c" returned: 0 in 0.392s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95ebf69-e279-48eb-9c1b-229e2acea88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84f5244-e14f-4021-a41f-0d9fd248d14c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10f8f23-c94a-4b1c-86c6-da81275168f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:13 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Volume volume-d84f5244-e14f-4021-a41f-0d9fd248d14c (d84f5244-e14f-4021-a41f-0d9fd248d14c): created successfully
Nov 06 08:20:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10f8f23-c94a-4b1c-86c6-da81275168f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Flow 'volume_create_manager' (ae4fe539-4e61-4f71-8931-a6f30b18cac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-042eadae-c9f2-4b43-9c82-41ef6991fb2e tempest-GroupsTest-2096046224 None] Created volume successfully.
Nov 06 08:20:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08d7843-e16c-43a7-ad99-d452ccc6c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0a91a55-3b24-486e-94af-cf24bb9888e2', 'volume_name': 'volume-c0a91a55-3b24-486e-94af-cf24bb9888e2', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd106e8e210>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2e6f19-25d7-4482-9bc4-f370f59d2880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2e6f19-25d7-4482-9bc4-f370f59d2880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872b2a49-f36f-4bcc-ba13-a314833e4fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Volume c0a91a55-3b24-486e-94af-cf24bb9888e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0a91a55-3b24-486e-94af-cf24bb9888e2', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd106e8e210>}
Nov 06 08:20:14 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Trying to clone c0a91a55-3b24-486e-94af-cf24bb9888e2 from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:20:15 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:20:15 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 08:20:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d23a755-48cc-46c9-9e00-3ff00f496031]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:15 devstack sudo[91721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD
Nov 06 08:20:15 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:15 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:15 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a is fetched for user 957a20283c3840fcaef5d113424193dc. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:20:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[514e7621-e98d-41e5-a45a-c4b572ef4606]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:15 devstack sudo[91726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD
Nov 06 08:20:15 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:16 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1294864846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a91a55-3b24-486e-94af-cf24bb9888e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e337edb40ee43c1ad02a36ae56161b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:13Z,use_quota=True,user_id='957a20283c3840fcaef5d113424193dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Creating volume c0a91a55-3b24-486e-94af-cf24bb9888e2 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:16 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:16 devstack sudo[91733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 1073741824
Nov 06 08:20:16 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Flow 'volume_create_manager' (c3ec2946-5495-4ec9-8249-c5aff8407daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5dae71-6411-4ec6-8852-a432670edb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5dae71-6411-4ec6-8852-a432670edb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1685521124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11978170-bf6f-4b1b-8960-25855c03e882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28b6a44cbd54650891be393e68d5b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:16Z,use_quota=True,user_id='4b8f52d6b7ce4415b0265c237c36d3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91db2ca8-60d5-4fa6-89c6-f6c8fb1a027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91db2ca8-60d5-4fa6-89c6-f6c8fb1a027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e84f055-5e8b-4504-a9ef-976e2f8745c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e84f055-5e8b-4504-a9ef-976e2f8745c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11978170-bf6f-4b1b-8960-25855c03e882', 'volume_name': 'volume-11978170-bf6f-4b1b-8960-25855c03e882', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf949c8-1d98-4b7c-ace6-266751e47ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf949c8-1d98-4b7c-ace6-266751e47ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcc3bf1-6e41-4cf8-8bae-75e37416fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Volume 11978170-bf6f-4b1b-8960-25855c03e882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11978170-bf6f-4b1b-8960-25855c03e882', 'volume_size': 1}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Acquiring lock "cinder-quobyte-d84f5244-e14f-4021-a41f-0d9fd248d14c" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Lock "cinder-quobyte-d84f5244-e14f-4021-a41f-0d9fd248d14c" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[708b00cb-61cd-4d68-90a2-965db72c87b7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:16 devstack sudo[91738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c
Nov 06 08:20:16 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:16 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 1073741824" returned: 0 in 0.584s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:16 devstack sudo[91741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2
Nov 06 08:20:16 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:16 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c" returned: 0 in 0.401s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:16 devstack sudo[91746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c
Nov 06 08:20:16 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:17 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2" returned: 0 in 0.289s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1685521124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11978170-bf6f-4b1b-8960-25855c03e882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28b6a44cbd54650891be393e68d5b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:16Z,use_quota=True,user_id='4b8f52d6b7ce4415b0265c237c36d3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Creating volume 11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:17 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:17 devstack sudo[91749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 1073741824
Nov 06 08:20:17 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Attempting download of b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume c0a91a55-3b24-486e-94af-cf24bb9888e2. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f6b3c-8a57-4b14-ae45-215344ba9572]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_zydp88rl {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:17 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d84f5244-e14f-4021-a41f-0d9fd248d14c" returned: 0 in 0.324s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Lock "cinder-quobyte-d84f5244-e14f-4021-a41f-0d9fd248d14c" released by "delete_volume" :: held 0.787s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:17 devstack sudo[91751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_zydp88rl
Nov 06 08:20:17 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Created reservations ['49ada0dd-154a-4868-9872-56f6a8aeed32'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:17 devstack cinder-volume[87143]: WARNING cinder.quota [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1798267972 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1798267972, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:20:17 devstack cinder-volume[87143]: WARNING cinder.quota [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1798267972 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1798267972, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Created reservations ['1b71db7f-cd02-469d-aa60-e6f9f980adaf', 'c318668a-841e-4e2f-bdfb-5ca6eed7b0f4', 'f6366e9d-c682-4c29-9353-cac9708bd8e7', 'd4fb333e-c801-4017-8885-922216095499'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:17 devstack sudo[91758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:17 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:17 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_zydp88rl" returned: 0 in 0.489s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_zydp88rl {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:17 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 1073741824" returned: 0 in 0.616s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:17 devstack sudo[91763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882
Nov 06 08:20:17 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:17 devstack sudo[91762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_zydp88rl
Nov 06 08:20:17 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:17 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.351s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:20:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-802e40b9-9cf3-45f1-be49-0f4e84a55b12 tempest-GroupsTest-2096046224 None] Delete group completed successfully.
Nov 06 08:20:17 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Created reservations ['35bde5f7-0a85-4c64-b2e2-d87fe79f1eda'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:18 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_zydp88rl" returned: 1 in 0.393s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_zydp88rl' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd4607-0f2c-48a2-b728-9a4f4e087646]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:18 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:18 devstack sudo[91770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:18 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882" returned: 0 in 0.343s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcc3bf1-6e41-4cf8-8bae-75e37416fa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11978170-bf6f-4b1b-8960-25855c03e882', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e470f4-af12-4809-b589-93dcf9c789e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:18 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Volume volume-11978170-bf6f-4b1b-8960-25855c03e882 (11978170-bf6f-4b1b-8960-25855c03e882): created successfully
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e470f4-af12-4809-b589-93dcf9c789e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Flow 'volume_create_manager' (c3ec2946-5495-4ec9-8249-c5aff8407daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bff3c244-08b3-4a65-81b7-63e4970c6c45 tempest-VolumesDeleteCascade-1561834240 None] Created volume successfully.
Nov 06 08:20:18 devstack sudo[91771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD
Nov 06 08:20:18 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:18 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.298s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:20:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-87bb9221-3aa9-4f64-9079-a41b4de79ec2 tempest-GroupsTest-2096046224 None] Delete group completed successfully.
Nov 06 08:20:18 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] b5f6cea8-26cc-40f2-998e-90a6fcdc116a was qcow2, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:18 devstack sudo[91778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2
Nov 06 08:20:18 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Creating offline snapshot e86e8848-9a77-4c36-bc1f-b7f11a2a3cad of volume 11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29179ff-b4d7-4795-984d-cb42d9199c07]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:18 devstack sudo[91783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882
Nov 06 08:20:18 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:19 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882" returned: 0 in 0.418s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:19 devstack sudo[91790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad 1G
Nov 06 08:20:19 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2c6090e8-4fa1-4a6c-8d08-5c8a1e8599c1 tempest-GroupsTest-2096046224 None] Group tempest-GroupsTest-Group-152321983: creating
Nov 06 08:20:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2c6090e8-4fa1-4a6c-8d08-5c8a1e8599c1 tempest-GroupsTest-2096046224 None] Group tempest-GroupsTest-Group-152321983: created successfully
Nov 06 08:20:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2c6090e8-4fa1-4a6c-8d08-5c8a1e8599c1 tempest-GroupsTest-2096046224 None] Create group completed successfully.
Nov 06 08:20:19 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad 1G" returned: 0 in 0.713s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11978170-bf6f-4b1b-8960-25855c03e882 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:19 devstack sudo[91796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11978170-bf6f-4b1b-8960-25855c03e882 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad
Nov 06 08:20:19 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:20 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11978170-bf6f-4b1b-8960-25855c03e882 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" returned: 0 in 0.371s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:20 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad is being set with open permissions: ugo+rw
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:20 devstack sudo[91802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad
Nov 06 08:20:20 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:20 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" returned: 0 in 0.300s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:20 devstack sudo[91806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.info
Nov 06 08:20:20 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:20 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.info" returned: 0 in 0.365s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:20 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.info is being set with open permissions: ugo+rw
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:20 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2" returned: 0 in 2.538s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_dtdbtcv2devstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:20:20 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Converted 112.00 MB image at 44.07 MB/s
Nov 06 08:20:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:20 devstack sudo[91809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.info
Nov 06 08:20:20 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:21 devstack sudo[91811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 1G
Nov 06 08:20:21 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:21 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.info" returned: 0 in 0.309s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:21 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7761b770-4e51-4f68-86c5-f269a76f5d95 tempest-VolumesDeleteCascade-1561834240 None] Create snapshot completed successfully
Nov 06 08:20:21 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 1G" returned: 0 in 0.498s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Downloaded image b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume c0a91a55-3b24-486e-94af-cf24bb9888e2 successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a for user 957a20283c3840fcaef5d113424193dc is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Marking volume c0a91a55-3b24-486e-94af-cf24bb9888e2 as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Copying metadata from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a to c0a91a55-3b24-486e-94af-cf24bb9888e2. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Creating volume glance metadata for volume c0a91a55-3b24-486e-94af-cf24bb9888e2 backed by image b5f6cea8-26cc-40f2-998e-90a6fcdc116a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Flow 'volume_create_manager' (a0e84745-9aac-4ab8-870d-b90a10cd61e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2561545-9bcd-4bb9-8f73-6a3cd988dfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2561545-9bcd-4bb9-8f73-6a3cd988dfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284150898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c9a7aa3-9d8a-40f4-826e-b36e2af3c214,host='devstack@QuobyteHD#QuobyteHD',id=6d61e0aa-a680-494f-8e1d-0f28a53a17f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b70b743911e4ff2ace8e05fdeca95b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:21Z,use_quota=True,user_id='635312bf92ca4a60b179eeffece55a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e250fc5-2e33-4f56-9d1c-b73127008339),volume_type_id=3e250fc5-2e33-4f56-9d1c-b73127008339)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aafaad9-85ab-49aa-ab89-01d41c7d0f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aafaad9-85ab-49aa-ab89-01d41c7d0f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698461ec-af0a-4617-a559-95320952668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698461ec-af0a-4617-a559-95320952668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d61e0aa-a680-494f-8e1d-0f28a53a17f7', 'volume_name': 'volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59923674-27f9-4a32-b1b9-1e5b009d1f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59923674-27f9-4a32-b1b9-1e5b009d1f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e314fc3-5e75-4bef-b44e-a3122db7f105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:21 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Volume 6d61e0aa-a680-494f-8e1d-0f28a53a17f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7', 'volume_size': 1}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0c9a7aa3-9d8a-40f4-826e-b36e2af3c214,created_at=2026-11-06T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284150898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c9a7aa3-9d8a-40f4-826e-b36e2af3c214,host='devstack@QuobyteHD#QuobyteHD',id=6d61e0aa-a680-494f-8e1d-0f28a53a17f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b70b743911e4ff2ace8e05fdeca95b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:21Z,use_quota=True,user_id='635312bf92ca4a60b179eeffece55a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e250fc5-2e33-4f56-9d1c-b73127008339),volume_type_id=3e250fc5-2e33-4f56-9d1c-b73127008339)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Creating volume 6d61e0aa-a680-494f-8e1d-0f28a53a17f7 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:21 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:21 devstack sudo[91818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7 1073741824
Nov 06 08:20:21 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872b2a49-f36f-4bcc-ba13-a314833e4fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a91a55-3b24-486e-94af-cf24bb9888e2', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd106e8e210>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7948dc-9bce-4cca-95b6-dfc02ba64775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:21 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Volume volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 (c0a91a55-3b24-486e-94af-cf24bb9888e2): created successfully
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7948dc-9bce-4cca-95b6-dfc02ba64775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Flow 'volume_create_manager' (ddeaeee4-27d4-40b6-8653-bb17eccc2545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:21 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c6ad94f0-e880-4b92-ab41-a48270aa783f tempest-ServerActionsTestOtherA-502115592 None] Created volume successfully.
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:22 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7 1073741824" returned: 0 in 0.557s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:22 devstack sudo[91824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7
Nov 06 08:20:22 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:22 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7" returned: 0 in 0.249s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e314fc3-5e75-4bef-b44e-a3122db7f105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b03dee-31e2-481c-9941-b493792d6dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Creating offline snapshot 45a1cf1c-eb66-4c29-b945-68cd55951b8e of volume 11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:20:22 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Volume volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7 (6d61e0aa-a680-494f-8e1d-0f28a53a17f7): created successfully
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b03dee-31e2-481c-9941-b493792d6dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Flow 'volume_create_manager' (a0e84745-9aac-4ab8-870d-b90a10cd61e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[66498dd1-dfd2-4a2e-949b-2c0b76e3ebca]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-09679ac5-ca42-401f-a970-dc699a9f1dfc tempest-GroupsTest-2096046224 None] Created volume successfully.
Nov 06 08:20:22 devstack sudo[91827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad
Nov 06 08:20:22 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:23 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" returned: 0 in 0.443s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11978170-bf6f-4b1b-8960-25855c03e882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:23 devstack sudo[91832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e 1G
Nov 06 08:20:23 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Flow 'volume_create_manager' (d6c262e8-fe6d-4431-b226-2067f41be672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11f5124-28d5-4e73-87dc-d26c015b259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11f5124-28d5-4e73-87dc-d26c015b259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467462146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c9a7aa3-9d8a-40f4-826e-b36e2af3c214,host='devstack@QuobyteHD#QuobyteHD',id=01d3437f-fab2-4a2a-bbe1-281ac8bd5260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b70b743911e4ff2ace8e05fdeca95b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:24Z,use_quota=True,user_id='635312bf92ca4a60b179eeffece55a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e250fc5-2e33-4f56-9d1c-b73127008339),volume_type_id=3e250fc5-2e33-4f56-9d1c-b73127008339)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545fbf0e-879d-4aa5-a6b7-48b67b2c2db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545fbf0e-879d-4aa5-a6b7-48b67b2c2db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acffb7b4-8d62-4e46-b724-c083c8bcd734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acffb7b4-8d62-4e46-b724-c083c8bcd734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d3437f-fab2-4a2a-bbe1-281ac8bd5260', 'volume_name': 'volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2135eda8-28d1-47ed-9711-fde33beeafa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2135eda8-28d1-47ed-9711-fde33beeafa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b0192a-9ace-4c84-bbe8-4847425a1821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Volume 01d3437f-fab2-4a2a-bbe1-281ac8bd5260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260', 'volume_size': 1}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:23 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e 1G" returned: 0 in 0.681s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:23 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e
Nov 06 08:20:23 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:24 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e" returned: 0 in 0.328s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:24 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e is being set with open permissions: ugo+rw
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:24 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e
Nov 06 08:20:24 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:24 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e" returned: 0 in 0.329s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0c9a7aa3-9d8a-40f4-826e-b36e2af3c214,created_at=2026-11-06T07:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467462146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c9a7aa3-9d8a-40f4-826e-b36e2af3c214,host='devstack@QuobyteHD#QuobyteHD',id=01d3437f-fab2-4a2a-bbe1-281ac8bd5260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b70b743911e4ff2ace8e05fdeca95b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:24Z,use_quota=True,user_id='635312bf92ca4a60b179eeffece55a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e250fc5-2e33-4f56-9d1c-b73127008339),volume_type_id=3e250fc5-2e33-4f56-9d1c-b73127008339)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Creating volume 01d3437f-fab2-4a2a-bbe1-281ac8bd5260 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:24 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:24 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260 1073741824
Nov 06 08:20:24 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:24 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2a2043b9-3c12-4cb2-b1b9-d1a5e92b4956 tempest-VolumesDeleteCascade-1561834240 None] Create snapshot completed successfully
Nov 06 08:20:25 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260 1073741824" returned: 0 in 0.597s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:25 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260
Nov 06 08:20:25 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-11978170-bf6f-4b1b-8960-25855c03e882-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-11978170-bf6f-4b1b-8960-25855c03e882-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Performing cascade delete. {{(pid=87143) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-45a1cf1c-eb66-4c29-b945-68cd55951b8e-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-add7df38-2454-444b-94c6-a3a9bdd9f05f req-1752b3f4-7887-47fe-a4a5-6424c5881958 tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:25 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260" returned: 0 in 0.482s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-add7df38-2454-444b-94c6-a3a9bdd9f05f req-1752b3f4-7887-47fe-a4a5-6424c5881958 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-45a1cf1c-eb66-4c29-b945-68cd55951b8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-add7df38-2454-444b-94c6-a3a9bdd9f05f req-1752b3f4-7887-47fe-a4a5-6424c5881958 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.082s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b0192a-9ace-4c84-bbe8-4847425a1821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8209e74c-0948-4d66-9f90-484696e30e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:25 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Volume volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260 (01d3437f-fab2-4a2a-bbe1-281ac8bd5260): created successfully
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8209e74c-0948-4d66-9f90-484696e30e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Flow 'volume_create_manager' (d6c262e8-fe6d-4431-b226-2067f41be672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-36c25578-92f8-44cf-852d-8ee4848699fe tempest-GroupsTest-2096046224 None] Created volume successfully.
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-add7df38-2454-444b-94c6-a3a9bdd9f05f req-1752b3f4-7887-47fe-a4a5-6424c5881958 tempest-ServerActionsTestOtherA-502115592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-c0a91a55-3b24-486e-94af-cf24bb9888e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b8c25e5-6325-4324-88d1-43b5a33b21f4', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-45a1cf1c-eb66-4c29-b945-68cd55951b8e" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-45a1cf1c-eb66-4c29-b945-68cd55951b8e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Deleting offline snapshot 45a1cf1c-eb66-4c29-b945-68cd55951b8e of volume 11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] snapshot_file for this snap is: volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca3ee0-5d38-4cf8-9cd0-7a1a38ed4851]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-add7df38-2454-444b-94c6-a3a9bdd9f05f req-1752b3f4-7887-47fe-a4a5-6424c5881958 tempest-ServerActionsTestOtherA-502115592 None] attachment_update completed successfully.
Nov 06 08:20:26 devstack sudo[91869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e
Nov 06 08:20:26 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b81ebb7a-8e3d-40ed-9b57-575aba1ebec2 tempest-GroupsTest-2096046224 None] Update group completed successfully.
Nov 06 08:20:26 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e" returned: 0 in 0.631s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11978170-bf6f-4b1b-8960-25855c03e882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:20:26 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd72268-638a-4e61-a280-ad7a2a6bd45a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:26 devstack sudo[91874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad
Nov 06 08:20:26 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:27 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" returned: 0 in 0.459s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11978170-bf6f-4b1b-8960-25855c03e882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:20:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:27 devstack sudo[91881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e
Nov 06 08:20:27 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:27 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e" returned: 0 in 0.522s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:27 devstack sudo[91888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e
Nov 06 08:20:27 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-717e8d88-4d9a-47ea-8949-2b401e87c5a2 tempest-GroupsTest-2096046224 None] Update group completed successfully.
Nov 06 08:20:27 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.45a1cf1c-eb66-4c29-b945-68cd55951b8e" returned: 0 in 0.365s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-45a1cf1c-eb66-4c29-b945-68cd55951b8e" released by "_delete_snapshot" :: held 2.164s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" released by "delete_snapshot" :: held 2.212s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Created reservations ['a1ecce27-0888-4d9d-ba32-c61bbb4995e6', 'fb87ccbf-dc25-409c-ae3e-d5967dcd67ae', '7481a686-f644-4c4d-9931-f9efd00651ae', 'e7f9bc08-aa32-45cf-98d4-52ea1c3a5d37'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:28 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Delete snapshot completed successfully.
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-45a1cf1c-eb66-4c29-b945-68cd55951b8e-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-e86e8848-9a77-4c36-bc1f-b7f11a2a3cad-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-e86e8848-9a77-4c36-bc1f-b7f11a2a3cad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Deleting offline snapshot e86e8848-9a77-4c36-bc1f-b7f11a2a3cad of volume 11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] snapshot_file for this snap is: volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b51a8e5-7b10-4bfb-bad4-3905a1bbf63a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:28 devstack sudo[91893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad
Nov 06 08:20:28 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:29 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" returned: 0 in 0.755s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11978170-bf6f-4b1b-8960-25855c03e882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:20:29 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0189db-b2bb-45a1-8787-18c5d5bfab29]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:29 devstack sudo[92123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882
Nov 06 08:20:29 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:29 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882" returned: 0 in 0.654s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:29 devstack sudo[92354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad
Nov 06 08:20:29 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Acquiring lock "cinder-quobyte-01d3437f-fab2-4a2a-bbe1-281ac8bd5260" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Lock "cinder-quobyte-01d3437f-fab2-4a2a-bbe1-281ac8bd5260" acquired by "delete_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628c444-afea-44a4-b104-25840153f907]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:30 devstack sudo[92362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:30 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:30 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" returned: 0 in 0.766s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:30 devstack sudo[92365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad
Nov 06 08:20:30 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:30 devstack sudo[92363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260
Nov 06 08:20:30 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:30 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.407s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 28 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:20:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:20:31 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882.e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" returned: 0 in 0.453s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:31 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260" returned: 0 in 0.649s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-e86e8848-9a77-4c36-bc1f-b7f11a2a3cad" released by "_delete_snapshot" :: held 2.893s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" released by "delete_snapshot" :: held 2.928s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:31 devstack sudo[92376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260
Nov 06 08:20:31 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Created reservations ['ab9d2d9b-b6f0-4a17-8f90-4b8e54a7c94d', '0b703132-689d-4dfd-b84f-c2df0935e19b', '77ca3549-2385-497d-b76b-e1158dd1c9fd', '2a079bda-fc50-4b55-a79f-bb6270b48616'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:31 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Delete snapshot completed successfully.
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-e86e8848-9a77-4c36-bc1f-b7f11a2a3cad-delete_snapshot" released by "delete_snapshot" :: held 3.242s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Snapshots deleted, issuing volume delete {{(pid=87143) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b0db5-1f32-4bc2-aa50-3f79002c9e30]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:31 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01d3437f-fab2-4a2a-bbe1-281ac8bd5260" returned: 0 in 0.444s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Lock "cinder-quobyte-01d3437f-fab2-4a2a-bbe1-281ac8bd5260" released by "delete_volume" :: held 1.188s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Acquiring lock "cinder-quobyte-6d61e0aa-a680-494f-8e1d-0f28a53a17f7" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Lock "cinder-quobyte-6d61e0aa-a680-494f-8e1d-0f28a53a17f7" acquired by "delete_volume" :: waited 0.031s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b9a022-9571-4573-9a54-05d334d4412e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:31 devstack sudo[92379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882
Nov 06 08:20:31 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:31 devstack sudo[92381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7
Nov 06 08:20:31 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:32 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7" returned: 0 in 0.626s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:32 devstack sudo[92391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7
Nov 06 08:20:32 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:32 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882" returned: 0 in 0.853s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:32 devstack sudo[92393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882
Nov 06 08:20:32 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:32 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d61e0aa-a680-494f-8e1d-0f28a53a17f7" returned: 0 in 0.443s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Lock "cinder-quobyte-6d61e0aa-a680-494f-8e1d-0f28a53a17f7" released by "delete_volume" :: held 1.159s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:32 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-11978170-bf6f-4b1b-8960-25855c03e882" returned: 0 in 0.412s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-11978170-bf6f-4b1b-8960-25855c03e882" released by "delete_volume" :: held 1.370s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Created reservations ['2ed4e74a-028c-4718-91c0-806397a41b3a', '9e372f64-6049-4833-bd39-caee576c9598', 'ed086024-4716-46ce-994e-ad6fcd44346e', '4e2f945d-82d1-48c3-99b6-e2f597f13bf8'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Created reservations ['12513eb3-7345-4a9c-8d4b-7c67ccab1a62'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:32 devstack cinder-volume[87143]: WARNING cinder.quota [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-776728973 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-776728973, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:20:32 devstack cinder-volume[87143]: WARNING cinder.quota [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-776728973 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-776728973, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Created reservations ['434dd756-cf90-4edf-8b17-4c58a295e73f', 'fbad8fe4-d8fc-427f-a3dc-dde369c439f6', 'dfb0bc07-76d9-4ee2-86b3-6fe86a6b3535', '26833204-3008-4c99-aae5-d45091e8c1f7'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:33 devstack sudo[92397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:33 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Created reservations ['e046971e-bf66-4222-bd55-bd6bd8556ac5', '2ee8f910-c01c-490b-8e42-d40b46aa42cd', '62783b78-a914-42ac-ac25-e9df7d3bb02c', '9470fb9b-4df3-48f7-a86f-fd5c00a45595'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:33 devstack sudo[92399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:33 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:33 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:33 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.463s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.794s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:20:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0c7548c5-1cc2-4120-bcd4-70d1e7c52460 tempest-GroupsTest-2096046224 None] Delete group completed successfully.
Nov 06 08:20:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Deleted volume successfully.
Nov 06 08:20:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f37ece1b-36ba-4275-9d49-e3cc742adc2f tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-11978170-bf6f-4b1b-8960-25855c03e882-delete_volume" released by "delete_volume" :: held 8.553s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Flow 'volume_create_manager' (7dd61566-fb56-4114-a174-806c1db3f34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac292a9-8905-4250-9678-9d300a6efc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac292a9-8905-4250-9678-9d300a6efc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2088649726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712a387e-05db-4ca7-be12-7762a4a77236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28b6a44cbd54650891be393e68d5b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:36Z,use_quota=True,user_id='4b8f52d6b7ce4415b0265c237c36d3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c517af32-4780-48fe-8955-4212333891dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c517af32-4780-48fe-8955-4212333891dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103e743-0890-4240-a639-0812cd56671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103e743-0890-4240-a639-0812cd56671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712a387e-05db-4ca7-be12-7762a4a77236', 'volume_name': 'volume-712a387e-05db-4ca7-be12-7762a4a77236', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4fa800-bda7-4cd8-b6a3-6d85a7c7e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4fa800-bda7-4cd8-b6a3-6d85a7c7e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5522c78-7064-4c2d-9f5e-dde2c8e82996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Volume 712a387e-05db-4ca7-be12-7762a4a77236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712a387e-05db-4ca7-be12-7762a4a77236', 'volume_size': 1}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2088649726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712a387e-05db-4ca7-be12-7762a4a77236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28b6a44cbd54650891be393e68d5b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:36Z,use_quota=True,user_id='4b8f52d6b7ce4415b0265c237c36d3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Creating volume 712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:36 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:36 devstack sudo[92410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 1073741824
Nov 06 08:20:36 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:36 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 1073741824" returned: 0 in 0.992s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:37 devstack sudo[92417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236
Nov 06 08:20:37 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:37 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236" returned: 0 in 0.474s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5522c78-7064-4c2d-9f5e-dde2c8e82996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712a387e-05db-4ca7-be12-7762a4a77236', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139421bf-e108-4019-b007-820ac325b31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Volume volume-712a387e-05db-4ca7-be12-7762a4a77236 (712a387e-05db-4ca7-be12-7762a4a77236): created successfully
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139421bf-e108-4019-b007-820ac325b31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Flow 'volume_create_manager' (7dd61566-fb56-4114-a174-806c1db3f34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:37 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c0c84289-9266-4c89-ae3a-07783036c140 tempest-VolumesDeleteCascade-1561834240 None] Created volume successfully.
Nov 06 08:20:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Creating offline snapshot 3b67c191-4f38-467d-8861-016a26bc4312 of volume 712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:20:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e23feb0-b28e-433c-84a8-f109dab188e5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:38 devstack sudo[92422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236
Nov 06 08:20:38 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:39 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236" returned: 0 in 0.572s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:39 devstack sudo[92427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 1G
Nov 06 08:20:39 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:39 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 1G" returned: 0 in 0.715s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712a387e-05db-4ca7-be12-7762a4a77236 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:40 devstack sudo[92433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712a387e-05db-4ca7-be12-7762a4a77236 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312
Nov 06 08:20:40 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:40 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712a387e-05db-4ca7-be12-7762a4a77236 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312" returned: 0 in 0.750s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:40 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 is being set with open permissions: ugo+rw
Nov 06 08:20:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:40 devstack sudo[92438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312
Nov 06 08:20:40 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Flow 'volume_create_manager' (c1c43e9f-cc76-4efe-9055-afd89b8c3b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b1ad30-fa74-49ea-a2d8-29eb3ef5204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:41 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b1ad30-fa74-49ea-a2d8-29eb3ef5204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-557790624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f57690e-a672-44a4-8aea-c5f72922efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d0278063164c2086ed9d8f79f742af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:41Z,use_quota=True,user_id='b8845401c8364d3d929fe67c03ff9647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8db37c-5970-4e2a-89cf-be1e01a8c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8db37c-5970-4e2a-89cf-be1e01a8c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0d467a-9294-4856-bfc2-1427b9e4594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0d467a-9294-4856-bfc2-1427b9e4594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f57690e-a672-44a4-8aea-c5f72922efe6', 'volume_name': 'volume-2f57690e-a672-44a4-8aea-c5f72922efe6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af33bb9-855a-4ca1-b867-1d954750e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af33bb9-855a-4ca1-b867-1d954750e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f5030e-ae71-463b-ba60-c58dfdfa0f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:41 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Volume 2f57690e-a672-44a4-8aea-c5f72922efe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f57690e-a672-44a4-8aea-c5f72922efe6', 'volume_size': 1}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312" returned: 0 in 0.438s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:41 devstack sudo[92442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.info
Nov 06 08:20:41 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:41 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.info" returned: 0 in 0.483s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:41 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.info is being set with open permissions: ugo+rw
Nov 06 08:20:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:41 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.info
Nov 06 08:20:41 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:42 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.info" returned: 0 in 0.345s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.480s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.929s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-557790624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f57690e-a672-44a4-8aea-c5f72922efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d0278063164c2086ed9d8f79f742af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:41Z,use_quota=True,user_id='b8845401c8364d3d929fe67c03ff9647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Creating volume 2f57690e-a672-44a4-8aea-c5f72922efe6 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:42 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:42 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6 1073741824
Nov 06 08:20:42 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a7163527-b593-4d1b-82f5-96f9ea66eb3e tempest-VolumesDeleteCascade-1561834240 None] Create snapshot completed successfully
Nov 06 08:20:42 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6 1073741824" returned: 0 in 0.683s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:42 devstack sudo[92497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6
Nov 06 08:20:42 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:43 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-04d50a39-2635-44bd-8f01-47be7807ca0a req-7252d55b-f2f6-4c34-a04f-7fed19f9fd3c tempest-ServerActionsTestOtherA-502115592 None] Terminate volume connection completed successfully.
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-04d50a39-2635-44bd-8f01-47be7807ca0a req-7252d55b-f2f6-4c34-a04f-7fed19f9fd3c tempest-ServerActionsTestOtherA-502115592 None] Deleting attachment 9b8c25e5-6325-4324-88d1-43b5a33b21f4. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:20:43 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6" returned: 0 in 0.525s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f5030e-ae71-463b-ba60-c58dfdfa0f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f57690e-a672-44a4-8aea-c5f72922efe6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0263d8-c0a7-47bc-8e3f-7aa5dba0d7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:43 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Volume volume-2f57690e-a672-44a4-8aea-c5f72922efe6 (2f57690e-a672-44a4-8aea-c5f72922efe6): created successfully
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0263d8-c0a7-47bc-8e3f-7aa5dba0d7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Flow 'volume_create_manager' (c1c43e9f-cc76-4efe-9055-afd89b8c3b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:43 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2e1885a2-7832-41b3-8231-16112c66ab1d tempest-VolumeQuotasAdminTestJSON-58250221 None] Created volume successfully.
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Flow 'volume_create_manager' (23e0bcac-2344-4f14-b7ea-fd8648943192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408e44e9-4db9-4b34-af3f-3bf74ac73e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408e44e9-4db9-4b34-af3f-3bf74ac73e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1536893129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d8ace2-3b26-4eaf-be65-11f70a56cb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28b6a44cbd54650891be393e68d5b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b67c191-4f38-467d-8861-016a26bc4312,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:44Z,use_quota=True,user_id='4b8f52d6b7ce4415b0265c237c36d3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5415773-07b0-4c8f-abf9-f038b23c5066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5415773-07b0-4c8f-abf9-f038b23c5066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd635f8-7a19-46e5-a165-3cdf8847d407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd635f8-7a19-46e5-a165-3cdf8847d407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00d8ace2-3b26-4eaf-be65-11f70a56cb8e', 'volume_name': 'volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e', 'volume_size': 1, 'snapshot_id': '3b67c191-4f38-467d-8861-016a26bc4312'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea871641-4dbd-4fca-a0eb-b8565be73c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea871641-4dbd-4fca-a0eb-b8565be73c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73410620-43e8-4dcc-b17b-258b177cb128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:44 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Volume 00d8ace2-3b26-4eaf-be65-11f70a56cb8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e', 'volume_size': 1, 'snapshot_id': '3b67c191-4f38-467d-8861-016a26bc4312'}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-3b67c191-4f38-467d-8861-016a26bc4312-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-3b67c191-4f38-467d-8861-016a26bc4312-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Creating volume 00d8ace2-3b26-4eaf-be65-11f70a56cb8e from snapshot 3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] snapshot: 3b67c191-4f38-467d-8861-016a26bc4312, volume: 00d8ace2-3b26-4eaf-be65-11f70a56cb8e,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8430b73-3416-4e8e-a2c1-17bd095d4229]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:44 devstack sudo[92506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312
Nov 06 08:20:44 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Acquiring lock "cinder-2f57690e-a672-44a4-8aea-c5f72922efe6-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "cinder-2f57690e-a672-44a4-8aea-c5f72922efe6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Acquiring lock "cinder-quobyte-2f57690e-a672-44a4-8aea-c5f72922efe6" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "cinder-quobyte-2f57690e-a672-44a4-8aea-c5f72922efe6" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e481879-d238-4ce9-b932-7ef6a5acf848]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:44 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312" returned: 0 in 0.628s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-712a387e-05db-4ca7-be12-7762a4a77236(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[941ee7cd-04e3-4da0-b438-9534481ffc21]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:44 devstack sudo[92510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6
Nov 06 08:20:44 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:44 devstack sudo[92515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236
Nov 06 08:20:44 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:45 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-04d50a39-2635-44bd-8f01-47be7807ca0a req-a1fff75b-91da-4786-b0e9-b8f1bd59627e tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6" returned: 0 in 0.457s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:45 devstack sudo[92526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6
Nov 06 08:20:45 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:45 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236" returned: 0 in 0.400s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:45 devstack sudo[92531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e
Nov 06 08:20:45 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:45 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2f57690e-a672-44a4-8aea-c5f72922efe6" returned: 0 in 0.294s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "cinder-quobyte-2f57690e-a672-44a4-8aea-c5f72922efe6" released by "delete_volume" :: held 0.829s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Created reservations ['f185076a-e3ff-455e-95b2-99086975fab3', '73791b19-e97b-4190-a7c3-cf19b57e19c6', '86cee734-1d79-4a52-a100-40e6a84c7ef9', 'ec3156a0-318d-4a05-9737-434d6389b493'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:45 devstack sudo[92539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:45 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Flow 'volume_create_manager' (a984f0fb-3b1a-4b2b-87f5-b8817778e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb22461-580f-4851-8454-5004055dbafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb22461-580f-4851-8454-5004055dbafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-912002460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baab6f1b-4951-4c44-a46d-253047f77063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942a213328864023a2db98418c11a35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:46Z,use_quota=True,user_id='dbc40ef98bd14de38a5d1cb394b8ba0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de544760-163a-4fdd-b449-c25c444918ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de544760-163a-4fdd-b449-c25c444918ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0c466b-35d2-42c4-bb41-9dbb2828a58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0c466b-35d2-42c4-bb41-9dbb2828a58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baab6f1b-4951-4c44-a46d-253047f77063', 'volume_name': 'volume-baab6f1b-4951-4c44-a46d-253047f77063', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61520a12-c0e4-4568-9cb6-2771fa64845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61520a12-c0e4-4568-9cb6-2771fa64845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a229165b-4e8d-4b8c-9512-e694cf00c4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Volume baab6f1b-4951-4c44-a46d-253047f77063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baab6f1b-4951-4c44-a46d-253047f77063', 'volume_size': 1}
Nov 06 08:20:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:46 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.460s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:20:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Deleted volume successfully.
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c61c1c83-7f52-4169-8de1-dca994adce82 tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "cinder-2f57690e-a672-44a4-8aea-c5f72922efe6-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Flow 'volume_create_manager' (7f98dfdd-7767-427e-a782-0e449bdf617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382e6c41-adfe-49c7-8b0e-91f610854e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382e6c41-adfe-49c7-8b0e-91f610854e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-260573812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff491bc-167e-46be-93ed-f06bce68c3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d0278063164c2086ed9d8f79f742af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:47Z,use_quota=True,user_id='b8845401c8364d3d929fe67c03ff9647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f9f983-f3b8-4336-a51f-5defd4b00f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f9f983-f3b8-4336-a51f-5defd4b00f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc897202-8313-456b-b2c9-1501ed50577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc897202-8313-456b-b2c9-1501ed50577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff491bc-167e-46be-93ed-f06bce68c3b6', 'volume_name': 'volume-dff491bc-167e-46be-93ed-f06bce68c3b6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5966f1b2-9c38-4e4f-a91d-2731ebbfbf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5966f1b2-9c38-4e4f-a91d-2731ebbfbf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e61fcf5-826e-4a6a-bf96-1bf0d611f050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Volume dff491bc-167e-46be-93ed-f06bce68c3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff491bc-167e-46be-93ed-f06bce68c3b6', 'volume_size': 1}
Nov 06 08:20:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:52 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" returned: 0 in 6.975s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:20:52 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Converted 1024.00 MB image at 146.79 MB/s
Nov 06 08:20:52 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e is being set with open permissions: ugo+rw
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:52 devstack sudo[92563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e
Nov 06 08:20:52 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:52 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" released by "_copy_volume_from_snapshot" :: held 8.347s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-3b67c191-4f38-467d-8861-016a26bc4312-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" released by "_create_volume_from_snapshot" :: held 8.408s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.426s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-04d50a39-2635-44bd-8f01-47be7807ca0a req-a1fff75b-91da-4786-b0e9-b8f1bd59627e tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.389s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-04d50a39-2635-44bd-8f01-47be7807ca0a req-a1fff75b-91da-4786-b0e9-b8f1bd59627e tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.717s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-912002460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baab6f1b-4951-4c44-a46d-253047f77063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942a213328864023a2db98418c11a35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:46Z,use_quota=True,user_id='dbc40ef98bd14de38a5d1cb394b8ba0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Creating volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:52 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73410620-43e8-4dcc-b17b-258b177cb128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e', 'volume_size': 1, 'snapshot_id': '3b67c191-4f38-467d-8861-016a26bc4312'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:52 devstack sudo[92566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 1073741824
Nov 06 08:20:52 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9468dd-3f14-4519-95f9-c3249953b3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:52 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Volume volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e (00d8ace2-3b26-4eaf-be65-11f70a56cb8e): created successfully
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9468dd-3f14-4519-95f9-c3249953b3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Flow 'volume_create_manager' (23e0bcac-2344-4f14-b7ea-fd8648943192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-04d50a39-2635-44bd-8f01-47be7807ca0a req-a1fff75b-91da-4786-b0e9-b8f1bd59627e tempest-ServerActionsTestOtherA-502115592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-c0a91a55-3b24-486e-94af-cf24bb9888e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b6dccc4-2ab0-483b-a0b7-e68c0c1b6b4a', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:20:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-832d4f1e-cf0b-4b1c-95e1-c6c325f1f9ce tempest-VolumesDeleteCascade-1561834240 None] Created volume successfully.
Nov 06 08:20:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-04d50a39-2635-44bd-8f01-47be7807ca0a req-a1fff75b-91da-4786-b0e9-b8f1bd59627e tempest-ServerActionsTestOtherA-502115592 None] attachment_update completed successfully.
Nov 06 08:20:52 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 1073741824" returned: 0 in 0.478s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:53 devstack sudo[92650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063
Nov 06 08:20:53 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:53 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-712a387e-05db-4ca7-be12-7762a4a77236-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063" returned: 0 in 0.461s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.783s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-260573812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff491bc-167e-46be-93ed-f06bce68c3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d0278063164c2086ed9d8f79f742af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:20:47Z,use_quota=True,user_id='b8845401c8364d3d929fe67c03ff9647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Creating volume dff491bc-167e-46be-93ed-f06bce68c3b6 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:20:53 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-712a387e-05db-4ca7-be12-7762a4a77236-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:53 devstack sudo[92692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6 1073741824
Nov 06 08:20:53 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a229165b-4e8d-4b8c-9512-e694cf00c4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baab6f1b-4951-4c44-a46d-253047f77063', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9a62a4-57ab-41c4-8247-438cd0684c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:53 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Volume volume-baab6f1b-4951-4c44-a46d-253047f77063 (baab6f1b-4951-4c44-a46d-253047f77063): created successfully
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9a62a4-57ab-41c4-8247-438cd0684c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Flow 'volume_create_manager' (a984f0fb-3b1a-4b2b-87f5-b8817778e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:53 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e5060c4b-3837-4f85-a79b-5d6430cdc71d tempest-SnapshotsActionsTest-979107642 None] Created volume successfully.
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Performing cascade delete. {{(pid=87143) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-3b67c191-4f38-467d-8861-016a26bc4312-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-3b67c191-4f38-467d-8861-016a26bc4312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-712a387e-05db-4ca7-be12-7762a4a77236" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-712a387e-05db-4ca7-be12-7762a4a77236" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-3b67c191-4f38-467d-8861-016a26bc4312" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-3b67c191-4f38-467d-8861-016a26bc4312" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Deleting offline snapshot 3b67c191-4f38-467d-8861-016a26bc4312 of volume 712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] snapshot_file for this snap is: volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c928cb55-d14f-4b8a-a5f1-161ffddecaac]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:54 devstack sudo[93022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312
Nov 06 08:20:54 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:54 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6 1073741824" returned: 0 in 0.797s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:54 devstack sudo[93040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6
Nov 06 08:20:54 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:54 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312" returned: 0 in 0.477s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-712a387e-05db-4ca7-be12-7762a4a77236(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f518beb-0fc8-4950-9048-9326cd8fc10c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:54 devstack sudo[93042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236
Nov 06 08:20:54 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:54 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6" returned: 0 in 0.300s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e61fcf5-826e-4a6a-bf96-1bf0d611f050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff491bc-167e-46be-93ed-f06bce68c3b6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3552781-049c-4894-a375-f3f3cd307577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:20:54 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Volume volume-dff491bc-167e-46be-93ed-f06bce68c3b6 (dff491bc-167e-46be-93ed-f06bce68c3b6): created successfully
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3552781-049c-4894-a375-f3f3cd307577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Flow 'volume_create_manager' (7f98dfdd-7767-427e-a782-0e449bdf617e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:20:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ff8dc384-30c9-446e-b85e-31acfdb4411e tempest-VolumeQuotasAdminTestJSON-58250221 None] Created volume successfully.
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Creating offline snapshot 02797345-c825-44c9-9b2f-80090f986bd5 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb21bbc-fcc9-4d3a-ba82-388b9381a909]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:55 devstack sudo[93047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063
Nov 06 08:20:55 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:55 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236" returned: 0 in 0.844s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:55 devstack sudo[93052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312
Nov 06 08:20:55 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:55 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063" returned: 0 in 0.602s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:55 devstack sudo[93057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 1G
Nov 06 08:20:55 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:55 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312" returned: 0 in 0.458s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:55 devstack sudo[93063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312
Nov 06 08:20:55 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:56 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236.3b67c191-4f38-467d-8861-016a26bc4312" returned: 0 in 0.415s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:56 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 1G" returned: 0 in 0.663s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-3b67c191-4f38-467d-8861-016a26bc4312" released by "_delete_snapshot" :: held 2.398s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:56 devstack sudo[93072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-712a387e-05db-4ca7-be12-7762a4a77236" released by "delete_snapshot" :: held 2.461s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:56 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Created reservations ['d0c533b9-1f56-4706-b952-87167a60a631', 'f130bf6a-d13f-4203-a209-9178216836f5', 'af7e9b69-f083-4857-9ae5-4c77d64d8855', '3a3ecab7-9eee-4017-9627-573fdb938662'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8db706e9-d08c-4153-ad4f-8bbbde32f9be tempest-VolumeQuotasAdminTestJSON-1474111215 None] Transfer volume completed successfully.
Nov 06 08:20:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Delete snapshot completed successfully.
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-3b67c191-4f38-467d-8861-016a26bc4312-delete_snapshot" released by "delete_snapshot" :: held 2.810s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Snapshots deleted, issuing volume delete {{(pid=87143) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-712a387e-05db-4ca7-be12-7762a4a77236" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-712a387e-05db-4ca7-be12-7762a4a77236" acquired by "delete_volume" :: waited 0.042s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f213e6-4e78-43da-9422-417a7818b8a1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:56 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.668s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:56 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 is being set with open permissions: ugo+rw
Nov 06 08:20:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:56 devstack sudo[93078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236
Nov 06 08:20:56 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:56 devstack sudo[93079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:20:57 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:57 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.495s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Acquiring lock "cinder-dff491bc-167e-46be-93ed-f06bce68c3b6-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Lock "cinder-dff491bc-167e-46be-93ed-f06bce68c3b6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:57 devstack sudo[93088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.info
Nov 06 08:20:57 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:57 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236" returned: 0 in 0.784s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:57 devstack sudo[93090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236
Nov 06 08:20:57 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Acquiring lock "cinder-quobyte-dff491bc-167e-46be-93ed-f06bce68c3b6" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Lock "cinder-quobyte-dff491bc-167e-46be-93ed-f06bce68c3b6" acquired by "delete_volume" :: waited 0.042s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecfef63-1b33-4c19-adae-e16bc3ae2372]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:57 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.info" returned: 0 in 0.469s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:57 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.info is being set with open permissions: ugo+rw
Nov 06 08:20:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:57 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6
Nov 06 08:20:57 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:58 devstack sudo[93095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.info
Nov 06 08:20:58 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:58 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-712a387e-05db-4ca7-be12-7762a4a77236" returned: 0 in 0.443s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-712a387e-05db-4ca7-be12-7762a4a77236" released by "delete_volume" :: held 1.377s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Created reservations ['090893b3-1b70-4b57-a29e-04427976e5b6', '8402a40e-6ac1-41fa-a08c-3bcc74c931ee', '95ddbea0-4e2a-4a7f-8953-d72ed916c275', 'e67b527a-9aa7-462b-80c0-585c03521d92'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:58 devstack sudo[93110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:58 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:58 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.info" returned: 0 in 0.593s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.660s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:58 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6" returned: 0 in 0.889s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:58 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6be6b72c-f54a-4af0-9503-32ce790c62f0 tempest-SnapshotsActionsTest-979107642 None] Create snapshot completed successfully
Nov 06 08:20:58 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6
Nov 06 08:20:58 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-00d8ace2-3b26-4eaf-be65-11f70a56cb8e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-00d8ace2-3b26-4eaf-be65-11f70a56cb8e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "cinder-quobyte-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" acquired by "delete_volume" :: waited 0.034s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2a8e21-38de-4456-8840-fa322c24b0e8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:59 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.772s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:20:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Deleted volume successfully.
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e4df5732-5275-4e1f-97c7-cc8f9c237b76 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-712a387e-05db-4ca7-be12-7762a4a77236-delete_volume" released by "delete_volume" :: held 5.682s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:59 devstack sudo[93141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e
Nov 06 08:20:59 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:59 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dff491bc-167e-46be-93ed-f06bce68c3b6" returned: 0 in 0.911s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Lock "cinder-quobyte-dff491bc-167e-46be-93ed-f06bce68c3b6" released by "delete_volume" :: held 1.883s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Created reservations ['fec5f34c-d336-46d3-afca-5ec3d6686b70', '51777f07-817a-41c7-824f-bb9e102612aa', 'aa5e858c-3e9d-48d5-b257-f7359be59c3a', 'c03f3dc8-9a79-462d-8ce7-3f5a34d27057'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:59 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root
Nov 06 08:20:59 devstack sudo[93149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:20:59 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" returned: 0 in 0.824s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:20:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:20:59 devstack sudo[93151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e
Nov 06 08:20:59 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:00 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.679s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Deleted volume successfully.
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-73d2c3fb-e11a-4ed3-8dcb-d1676321732b tempest-VolumeQuotasAdminTestJSON-788392140 None] Lock "cinder-dff491bc-167e-46be-93ed-f06bce68c3b6-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:00 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" returned: 0 in 0.814s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Creating offline snapshot db519680-648d-4601-9b58-08bd08405a64 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-quobyte-00d8ace2-3b26-4eaf-be65-11f70a56cb8e" released by "delete_volume" :: held 1.846s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d879b2f0-be27-4f39-ac15-c00efdd2ca22]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:00 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Created reservations ['8d300ffd-9a32-4b8c-82eb-f70256eebe49', '31f4eaae-ad2f-458f-9a1c-db31aeabd5ab', '98367342-25ce-4c23-8d01-811c655580cd', '15375912-d2e4-4187-acad-1ae1c82d6627'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:01 devstack sudo[93155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:01 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:01 devstack sudo[93157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:01 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:01 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.657s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:01 devstack sudo[93164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 1G
Nov 06 08:21:01 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:01 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.555s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Deleted volume successfully.
Nov 06 08:21:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-88eeaf2c-c750-4ab5-b951-3737123f1764 tempest-VolumesDeleteCascade-1561834240 None] Lock "cinder-00d8ace2-3b26-4eaf-be65-11f70a56cb8e-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:02 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 1G" returned: 0 in 0.695s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:02 devstack sudo[93171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64
Nov 06 08:21:02 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:02 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64" returned: 0 in 0.437s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:02 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 is being set with open permissions: ugo+rw
Nov 06 08:21:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:02 devstack sudo[93177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64
Nov 06 08:21:02 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:02 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64" returned: 0 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:03 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7d3ec92e-7955-463e-9bcb-f29fdff8a333 tempest-SnapshotsActionsTest-979107642 None] Create snapshot completed successfully
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-db519680-648d-4601-9b58-08bd08405a64-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-db519680-648d-4601-9b58-08bd08405a64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-db519680-648d-4601-9b58-08bd08405a64" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-db519680-648d-4601-9b58-08bd08405a64" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Deleting offline snapshot db519680-648d-4601-9b58-08bd08405a64 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] snapshot_file for this snap is: volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4fddcf-b8df-4181-a7e7-32cba5d8755b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:04 devstack sudo[93181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64
Nov 06 08:21:04 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:04 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64" returned: 0 in 0.629s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b7d548-b978-4bbb-9655-7026cc5b6a63]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:05 devstack sudo[93186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:05 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:05 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.473s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:05 devstack sudo[93196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64
Nov 06 08:21:05 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:05 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64" returned: 0 in 0.559s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:06 devstack sudo[93205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64
Nov 06 08:21:06 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:06 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.db519680-648d-4601-9b58-08bd08405a64" returned: 0 in 0.278s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-db519680-648d-4601-9b58-08bd08405a64" released by "_delete_snapshot" :: held 2.108s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" released by "delete_snapshot" :: held 2.160s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:06 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=129,cinder:SELECT=130,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:21:06 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=143,cinder:UPDATE=140,cinder:INSERT=34,cinder:DELETE=9 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:21:06 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Created reservations ['bed70852-c863-469d-9927-57027478f14b', 'bc6870e2-6afb-48d6-9e16-770616085f2e', '4a9f0efc-5e4a-4016-883c-85bb9932ee68', '2f6d50bf-18ac-44d6-b755-1ff5b7aebd81'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:06 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Delete snapshot completed successfully.
Nov 06 08:21:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86d6541c-36ab-45e9-bedc-0f550b4f0755 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-db519680-648d-4601-9b58-08bd08405a64-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Creating offline snapshot 00c33fd3-96b5-4a77-aa51-5776ba444cb7 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:21:07 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c05953-3a22-4e4c-9b9e-0ab00855a999]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:08 devstack sudo[93208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:08 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:08 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.470s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:08 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 1G
Nov 06 08:21:08 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:09 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 1G" returned: 0 in 0.660s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:09 devstack sudo[93219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7
Nov 06 08:21:09 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Flow 'volume_create_manager' (b6a33ab9-0f95-4869-95a1-53c06edfe19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2781092a-cbfd-4f2a-9886-ad7a62eaf99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2781092a-cbfd-4f2a-9886-ad7a62eaf99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1360072815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e8f57c-5ae3-491f-a0d6-6fff3427eda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4c54e7ed7a4c9f81ecc7f4e8eb52bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:09Z,use_quota=True,user_id='8da3b891d0b54ce999b7e2b6c97b1fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d9d8ab-fb51-499d-951b-4ccb93f44450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d9d8ab-fb51-499d-951b-4ccb93f44450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64274fba-7b26-4767-b021-c8e77d402c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64274fba-7b26-4767-b021-c8e77d402c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e8f57c-5ae3-491f-a0d6-6fff3427eda1', 'volume_name': 'volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f3bc3d-0b3c-4b7f-bb9e-83108a7b334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f3bc3d-0b3c-4b7f-bb9e-83108a7b334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6472b3d-16bc-4087-ade8-d99d5809c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:09 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Volume 01e8f57c-5ae3-491f-a0d6-6fff3427eda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1', 'volume_size': 1}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:09 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7" returned: 0 in 0.347s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:09 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 is being set with open permissions: ugo+rw
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:09 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7
Nov 06 08:21:09 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:09 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7" returned: 0 in 0.271s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1360072815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e8f57c-5ae3-491f-a0d6-6fff3427eda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4c54e7ed7a4c9f81ecc7f4e8eb52bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:09Z,use_quota=True,user_id='8da3b891d0b54ce999b7e2b6c97b1fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Creating volume 01e8f57c-5ae3-491f-a0d6-6fff3427eda1 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:21:09 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:21:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:09 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1 1073741824
Nov 06 08:21:09 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ee8e6f0f-f80e-4ee1-a49b-19f3bf1b0887 tempest-SnapshotsActionsTest-979107642 None] Create snapshot completed successfully
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-00c33fd3-96b5-4a77-aa51-5776ba444cb7-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-00c33fd3-96b5-4a77-aa51-5776ba444cb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-00c33fd3-96b5-4a77-aa51-5776ba444cb7" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-00c33fd3-96b5-4a77-aa51-5776ba444cb7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Deleting offline snapshot 00c33fd3-96b5-4a77-aa51-5776ba444cb7 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] snapshot_file for this snap is: volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0669a0d-49ca-42b8-b942-20351ea38136]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:10 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1 1073741824" returned: 0 in 0.617s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:10 devstack sudo[93234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7
Nov 06 08:21:10 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:10 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1
Nov 06 08:21:10 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:10 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1" returned: 0 in 0.461s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:10 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6472b3d-16bc-4087-ade8-d99d5809c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5bd009-bc34-4284-ba6e-b5853564b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7" returned: 0 in 0.635s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:10 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Volume volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1 (01e8f57c-5ae3-491f-a0d6-6fff3427eda1): created successfully
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5bd009-bc34-4284-ba6e-b5853564b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Flow 'volume_create_manager' (b6a33ab9-0f95-4869-95a1-53c06edfe19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f574d-cf42-464b-92e4-ae26f3e5dbc1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:11 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-55ea2f22-3185-40b6-bbcd-0c34cf931958 tempest-VolumesTransfersTest-828839489 None] Created volume successfully.
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Flow 'volume_create_manager' (fcd26c6f-0422-45d1-8146-102fd1e556b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:11 devstack sudo[93249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:11 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153265d7-3ad5-49a9-b4df-fbc5a4b60e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153265d7-3ad5-49a9-b4df-fbc5a4b60e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1925387240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afdba4a-d347-4c96-8f01-feef7278c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fac7b64134cddaf8f5cd6587b5558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:11Z,use_quota=True,user_id='7d0ae8e288834deda5a7707b5dca2bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5289a0df-68e9-42ed-b47f-839a8f985b00),volume_type_id=5289a0df-68e9-42ed-b47f-839a8f985b00)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad4920-5622-4bb5-8258-10af81368570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad4920-5622-4bb5-8258-10af81368570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204cca18-8c30-4a9f-a3f7-455f44cc6ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204cca18-8c30-4a9f-a3f7-455f44cc6ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0afdba4a-d347-4c96-8f01-feef7278c485', 'volume_name': 'volume-0afdba4a-d347-4c96-8f01-feef7278c485', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b53200-6ad9-4711-8108-fa9fdae723f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b53200-6ad9-4711-8108-fa9fdae723f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c86050e-bb1d-4577-86e2-df3fe1d97b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:11 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Volume 0afdba4a-d347-4c96-8f01-feef7278c485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0afdba4a-d347-4c96-8f01-feef7278c485', 'volume_size': 1}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1925387240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afdba4a-d347-4c96-8f01-feef7278c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fac7b64134cddaf8f5cd6587b5558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:11Z,use_quota=True,user_id='7d0ae8e288834deda5a7707b5dca2bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5289a0df-68e9-42ed-b47f-839a8f985b00),volume_type_id=5289a0df-68e9-42ed-b47f-839a8f985b00)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Creating volume 0afdba4a-d347-4c96-8f01-feef7278c485 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:21:11 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:11 devstack sudo[93251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485 1073741824
Nov 06 08:21:11 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:11 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.505s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:11 devstack sudo[93259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7
Nov 06 08:21:11 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:11 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485 1073741824" returned: 0 in 0.562s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:11 devstack sudo[93266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485
Nov 06 08:21:11 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:12 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7" returned: 0 in 0.664s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:12 devstack sudo[93279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7
Nov 06 08:21:12 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:12 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485" returned: 0 in 0.503s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3591ecf3-5bbc-4234-b931-632db27b2578 tempest-VolumesTransfersTest-2085402291 None] Transfer volume completed successfully.
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c86050e-bb1d-4577-86e2-df3fe1d97b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0afdba4a-d347-4c96-8f01-feef7278c485', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d89966-9439-4bc5-a943-bed68456a189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Volume volume-0afdba4a-d347-4c96-8f01-feef7278c485 (0afdba4a-d347-4c96-8f01-feef7278c485): created successfully
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d89966-9439-4bc5-a943-bed68456a189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Flow 'volume_create_manager' (fcd26c6f-0422-45d1-8146-102fd1e556b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-23079528-acd3-43a9-bcfc-741553cd0b55 tempest-VolumeTypesAccessTest-881290285 None] Created volume successfully.
Nov 06 08:21:12 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.00c33fd3-96b5-4a77-aa51-5776ba444cb7" returned: 0 in 0.516s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-00c33fd3-96b5-4a77-aa51-5776ba444cb7" released by "_delete_snapshot" :: held 2.461s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" released by "delete_snapshot" :: held 2.494s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Created reservations ['216a1d8e-6132-4ad2-b64d-38b690876f90', '98bfe8e8-2faa-4671-b7bd-49796ca7dd83', 'c03b8aaf-0247-4557-af45-2b9f64499dfa', '90715b63-87aa-46cd-8822-8a0221762d93'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Delete snapshot completed successfully.
Nov 06 08:21:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-54234160-7128-4fe6-8b26-e3e435c7e827 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-00c33fd3-96b5-4a77-aa51-5776ba444cb7-delete_snapshot" released by "delete_snapshot" :: held 2.743s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Acquiring lock "cinder-01e8f57c-5ae3-491f-a0d6-6fff3427eda1-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-01e8f57c-5ae3-491f-a0d6-6fff3427eda1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Acquiring lock "cinder-quobyte-01e8f57c-5ae3-491f-a0d6-6fff3427eda1" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-quobyte-01e8f57c-5ae3-491f-a0d6-6fff3427eda1" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Acquiring lock "cinder-0afdba4a-d347-4c96-8f01-feef7278c485-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e49608-5919-49d0-95f0-2ef27ac9ed39]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Lock "cinder-0afdba4a-d347-4c96-8f01-feef7278c485-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Acquiring lock "cinder-quobyte-0afdba4a-d347-4c96-8f01-feef7278c485" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Lock "cinder-quobyte-0afdba4a-d347-4c96-8f01-feef7278c485" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:13 devstack sudo[93314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1
Nov 06 08:21:13 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39f66a7-7028-4791-b722-3f8c8cabf7a4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:13 devstack sudo[93317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485
Nov 06 08:21:13 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:13 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Creating offline snapshot a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1" returned: 0 in 0.565s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[654ce5b0-69e6-4d6a-9577-9c97b97d741b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:13 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1
Nov 06 08:21:13 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:14 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485" returned: 0 in 0.493s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:14 devstack sudo[93336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485
Nov 06 08:21:14 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:14 devstack sudo[93333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:14 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:14 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-01e8f57c-5ae3-491f-a0d6-6fff3427eda1" returned: 0 in 0.282s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-quobyte-01e8f57c-5ae3-491f-a0d6-6fff3427eda1" released by "delete_volume" :: held 0.936s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Created reservations ['c9390304-75f7-4fb8-a0c1-29ba452ac235', '634f90a9-0c48-47c5-878b-58e609deb06c', '64284f5c-17ab-423c-87d0-1e4ae01be86b', '30b1445d-f0bc-4c21-a560-278a31edb8da'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:14 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0afdba4a-d347-4c96-8f01-feef7278c485" returned: 0 in 0.331s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Lock "cinder-quobyte-0afdba4a-d347-4c96-8f01-feef7278c485" released by "delete_volume" :: held 0.895s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:14 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.461s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:14 devstack sudo[93344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 1G
Nov 06 08:21:14 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:14 devstack cinder-volume[87143]: WARNING cinder.quota [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1216012623 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1216012623, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:21:14 devstack cinder-volume[87143]: WARNING cinder.quota [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1216012623 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1216012623, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:14 devstack sudo[93346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:14 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Created reservations ['d3f9b7d6-6379-42bf-8558-8b1f7ccd9ab2', '022988c9-e62e-43d6-a424-62438c7470ab', 'c0d586c6-ce37-41a7-b582-909bc87cda5f', '01ddbbf5-779b-42b1-8393-c6a120058828'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:14 devstack sudo[93348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:14 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:14 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.283s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Deleted volume successfully.
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81fe35ea-d222-4651-8756-031dc0fe9580 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-01e8f57c-5ae3-491f-a0d6-6fff3427eda1-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:14 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.277s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Deleted volume successfully.
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2ce68196-ec83-4f19-aa5c-91ea71537f1a tempest-VolumeTypesAccessTest-881290285 None] Lock "cinder-0afdba4a-d347-4c96-8f01-feef7278c485-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:14 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 1G" returned: 0 in 0.521s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:15 devstack sudo[93356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2
Nov 06 08:21:15 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:15 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" returned: 0 in 0.291s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:15 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 is being set with open permissions: ugo+rw
Nov 06 08:21:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:15 devstack sudo[93361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2
Nov 06 08:21:15 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:15 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" returned: 0 in 0.277s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.691s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-21f48df2-370e-4040-b9f1-fca18f66685e tempest-SnapshotsActionsTest-979107642 None] Create snapshot completed successfully
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Flow 'volume_create_manager' (a5689fe5-f717-4075-84b4-3ac1d07a09a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e16657-63f8-4e82-b173-07214b11e176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e16657-63f8-4e82-b173-07214b11e176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-698420634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b37d536-071f-4caa-8ce5-efb6ce5b3a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4c54e7ed7a4c9f81ecc7f4e8eb52bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:16Z,use_quota=True,user_id='8da3b891d0b54ce999b7e2b6c97b1fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb27d9d-a1c8-4bde-9264-5c78c00fecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb27d9d-a1c8-4bde-9264-5c78c00fecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15d6ac2-ae7e-4bd5-a1b6-aa55457390ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15d6ac2-ae7e-4bd5-a1b6-aa55457390ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b37d536-071f-4caa-8ce5-efb6ce5b3a99', 'volume_name': 'volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a327ca1a-209f-4a78-8020-d24c3d9e512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a327ca1a-209f-4a78-8020-d24c3d9e512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccadacd0-e499-4df1-9b3a-24e6c38036f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Volume 0b37d536-071f-4caa-8ce5-efb6ce5b3a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99', 'volume_size': 1}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-698420634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b37d536-071f-4caa-8ce5-efb6ce5b3a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4c54e7ed7a4c9f81ecc7f4e8eb52bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:16Z,use_quota=True,user_id='8da3b891d0b54ce999b7e2b6c97b1fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Creating volume 0b37d536-071f-4caa-8ce5-efb6ce5b3a99 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:21:16 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:16 devstack sudo[93365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99 1073741824
Nov 06 08:21:16 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Deleting offline snapshot a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] snapshot_file for this snap is: volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69f0eb7-6cb3-4ef0-b2ad-e07f7b569640]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:16 devstack sudo[93367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2
Nov 06 08:21:16 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:16 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99 1073741824" returned: 0 in 0.518s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:16 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" returned: 0 in 0.463s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:16 devstack sudo[93376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99
Nov 06 08:21:16 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9582d47-1051-4087-a481-e3f37f376e7a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:16 devstack sudo[93378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:16 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:17 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99" returned: 0 in 0.292s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccadacd0-e499-4df1-9b3a-24e6c38036f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862152c1-c022-4fef-a5d9-82cca1a5004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:17 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Volume volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99 (0b37d536-071f-4caa-8ce5-efb6ce5b3a99): created successfully
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862152c1-c022-4fef-a5d9-82cca1a5004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Flow 'volume_create_manager' (a5689fe5-f717-4075-84b4-3ac1d07a09a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-32469e30-498a-473c-9090-1c128d65c904 tempest-VolumesTransfersTest-828839489 None] Created volume successfully.
Nov 06 08:21:17 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.430s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:17 devstack sudo[93384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2
Nov 06 08:21:17 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:17 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:17 devstack sudo[93390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2
Nov 06 08:21:17 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:17 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" returned: 0 in 0.254s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2" released by "_delete_snapshot" :: held 1.675s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" released by "delete_snapshot" :: held 1.695s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:17 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Created reservations ['4f3eb120-a1c3-46b9-845e-2a6507bb31c1', '2e029554-2717-4557-8c0f-d41c9ee746bd', 'a39d625a-9501-4db3-90b1-5ef588ac384b', '73f995e2-0df6-4f4c-ba4a-8fa9aa4b62dc'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Delete snapshot completed successfully.
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-559128d6-0fc6-412d-bd95-6dea90f46963 tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-a5ae4bc2-c0b3-47b4-ab7b-b98a7014bcd2-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Acquiring lock "cinder-0b37d536-071f-4caa-8ce5-efb6ce5b3a99-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-0b37d536-071f-4caa-8ce5-efb6ce5b3a99-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Acquiring lock "cinder-quobyte-0b37d536-071f-4caa-8ce5-efb6ce5b3a99" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-quobyte-0b37d536-071f-4caa-8ce5-efb6ce5b3a99" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Creating offline snapshot 32db16e4-6ea5-404d-823f-e2c12a7f396b of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a7e61-3849-406a-9990-8ee4cc4af4f0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd25dbf-0e7d-48a8-a892-7c16cca2b7d5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:18 devstack sudo[93393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99
Nov 06 08:21:18 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:18 devstack sudo[93394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:18 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:19 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99" returned: 0 in 0.413s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:19 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.417s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:19 devstack sudo[93403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99
Nov 06 08:21:19 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:19 devstack sudo[93405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b 1G
Nov 06 08:21:19 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:19 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0b37d536-071f-4caa-8ce5-efb6ce5b3a99" returned: 0 in 0.259s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-quobyte-0b37d536-071f-4caa-8ce5-efb6ce5b3a99" released by "delete_volume" :: held 0.771s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Created reservations ['790e0da9-08ec-4b84-a1a9-00982ecda059', '98dcef78-54ec-4b4e-9086-2aa4ebd8da13', 'd29e76a0-9cfc-4791-a504-8b2474109acc', 'c4517147-7bb9-4b90-b557-e713e8d194d2'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:19 devstack sudo[93414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:19 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:19 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b 1G" returned: 0 in 0.615s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:19 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b
Nov 06 08:21:19 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:19 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.312s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Deleted volume successfully.
Nov 06 08:21:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ccafa71-2a78-43ef-8b80-50f692c225c1 tempest-VolumesTransfersTest-1848183927 None] Lock "cinder-0b37d536-071f-4caa-8ce5-efb6ce5b3a99-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:20 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:20 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b is being set with open permissions: ugo+rw
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:20 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b
Nov 06 08:21:20 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:20 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b" returned: 0 in 0.259s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-97de336e-a4b6-4001-b792-fe15ff18eca3 tempest-SnapshotsActionsTest-979107642 None] Create snapshot completed successfully
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-32db16e4-6ea5-404d-823f-e2c12a7f396b-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-32db16e4-6ea5-404d-823f-e2c12a7f396b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Acquiring lock "cinder-quobyte-32db16e4-6ea5-404d-823f-e2c12a7f396b" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-32db16e4-6ea5-404d-823f-e2c12a7f396b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Deleting offline snapshot 32db16e4-6ea5-404d-823f-e2c12a7f396b of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] snapshot_file for this snap is: volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d678e-16ae-4f3f-b3c1-a13e86845bc8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:21 devstack sudo[93426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b
Nov 06 08:21:21 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:21 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b" returned: 0 in 0.464s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:21 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff588d2-a259-48eb-8e4b-0502e9a3ad0a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:21 devstack sudo[93432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:21 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:22 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.532s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:22 devstack sudo[93440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b
Nov 06 08:21:22 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:22 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b" returned: 0 in 0.507s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:22 devstack sudo[93446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b
Nov 06 08:21:22 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:22 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.32db16e4-6ea5-404d-823f-e2c12a7f396b" returned: 0 in 0.327s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-32db16e4-6ea5-404d-823f-e2c12a7f396b" released by "_delete_snapshot" :: held 2.005s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" released by "delete_snapshot" :: held 2.041s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:23 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Created reservations ['a66c90fd-de83-4742-b160-16a7d796dbed', 'b0d87b4d-0428-4a5b-81e6-c328807bb701', 'f3c060ce-8761-4eb0-8611-dbac4da136cb', '21b2bb32-f571-4c21-9f2b-d0bc22ce359e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Delete snapshot completed successfully.
Nov 06 08:21:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6b499dc-3e88-4b0d-86da-5347738ca48a tempest-SnapshotsActionsTest-2013803955 None] Lock "cinder-32db16e4-6ea5-404d-823f-e2c12a7f396b-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "cinder-02797345-c825-44c9-9b2f-80090f986bd5-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-02797345-c825-44c9-9b2f-80090f986bd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "cinder-quobyte-02797345-c825-44c9-9b2f-80090f986bd5" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-quobyte-02797345-c825-44c9-9b2f-80090f986bd5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Deleting offline snapshot 02797345-c825-44c9-9b2f-80090f986bd5 of volume baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] snapshot_file for this snap is: volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[965460ec-e09a-4713-a638-bed09013e7f8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:25 devstack sudo[93455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:25 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:25 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.395s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baab6f1b-4951-4c44-a46d-253047f77063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:21:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c131b69-e1bb-46f5-af59-ffd341b133cd]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:25 devstack sudo[93460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063
Nov 06 08:21:25 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:25 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:25 devstack sudo[93465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:25 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:26 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.393s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:26 devstack sudo[93472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5
Nov 06 08:21:26 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:26 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063.02797345-c825-44c9-9b2f-80090f986bd5" returned: 0 in 0.330s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-quobyte-02797345-c825-44c9-9b2f-80090f986bd5" released by "_delete_snapshot" :: held 1.665s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" released by "delete_snapshot" :: held 1.688s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:26 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Created reservations ['709dc817-3bc7-4fe9-8639-e6771cb19e24', '39cd9746-dcde-4995-87a7-0eecb9cd797a', 'c88c799f-5f48-4b07-a852-7f4233245681', '339a9950-0ae0-459b-8c69-33361644b9b7'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Delete snapshot completed successfully.
Nov 06 08:21:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8764d1a1-5891-4ad8-b622-26ea8e5844aa tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-02797345-c825-44c9-9b2f-80090f986bd5-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "cinder-baab6f1b-4951-4c44-a46d-253047f77063-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-baab6f1b-4951-4c44-a46d-253047f77063-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[07031518-1855-4ef5-87d3-92ae399fb08a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:27 devstack sudo[93476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063
Nov 06 08:21:27 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Flow 'volume_create_manager' (24b7aeb2-6d72-4af3-ac19-1df86f942878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8be0c85-7979-48dc-8b4f-2a47ca1696c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8be0c85-7979-48dc-8b4f-2a47ca1696c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1820364920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76624209-9008-48e1-8d29-e76d20d4825a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a8e2e75da546cca99b8ed7e4fed75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:28Z,use_quota=True,user_id='deb211327d244060bbee737bfc6047ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9938a6-df58-4b04-8e30-383aefe20241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9938a6-df58-4b04-8e30-383aefe20241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcae6cc-92a5-413e-9749-83cfaf63e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcae6cc-92a5-413e-9749-83cfaf63e794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76624209-9008-48e1-8d29-e76d20d4825a', 'volume_name': 'volume-76624209-9008-48e1-8d29-e76d20d4825a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2832a285-f290-4783-9b65-cbf787366f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2832a285-f290-4783-9b65-cbf787366f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e2bec5-e1b7-484f-a301-9d620db84f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:27 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Volume 76624209-9008-48e1-8d29-e76d20d4825a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76624209-9008-48e1-8d29-e76d20d4825a', 'volume_size': 1}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1820364920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76624209-9008-48e1-8d29-e76d20d4825a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a8e2e75da546cca99b8ed7e4fed75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:28Z,use_quota=True,user_id='deb211327d244060bbee737bfc6047ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Creating volume 76624209-9008-48e1-8d29-e76d20d4825a {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:21:27 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:27 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063" returned: 0 in 0.492s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:27 devstack sudo[93481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a 1073741824
Nov 06 08:21:27 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:27 devstack sudo[93482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063
Nov 06 08:21:27 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:28 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-baab6f1b-4951-4c44-a46d-253047f77063" returned: 0 in 0.300s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-quobyte-baab6f1b-4951-4c44-a46d-253047f77063" released by "delete_volume" :: held 0.872s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Created reservations ['228bd596-6fd1-4d62-b43d-8add68751f69', 'a109ce91-9e2d-4ecd-9b23-9c09a529b2ca', '8e5d0e52-18ac-42ca-aaec-46967b075bf9', 'e0203edc-1578-4d0f-9454-f07c8848a744'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:28 devstack sudo[93490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:28 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:28 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a 1073741824" returned: 0 in 0.572s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:28 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a
Nov 06 08:21:28 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:28 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.305s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:28 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Deleted volume successfully.
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3145faaa-971d-4a99-9c90-15f8083cb752 tempest-SnapshotsActionsTest-979107642 None] Lock "cinder-baab6f1b-4951-4c44-a46d-253047f77063-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:28 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a" returned: 0 in 0.316s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e2bec5-e1b7-484f-a301-9d620db84f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76624209-9008-48e1-8d29-e76d20d4825a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b72400f-4856-45e3-b049-d44e338b0d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:28 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Volume volume-76624209-9008-48e1-8d29-e76d20d4825a (76624209-9008-48e1-8d29-e76d20d4825a): created successfully
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b72400f-4856-45e3-b049-d44e338b0d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Flow 'volume_create_manager' (24b7aeb2-6d72-4af3-ac19-1df86f942878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:28 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cde8d822-4f4c-4bc6-a982-ccc30f6cb152 tempest-VolumesNegativeTest-602981087 None] Created volume successfully.
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:30 devstack sudo[93496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:30 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:30 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.307s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:21:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Flow 'volume_create_manager' (11d31478-10ee-42bc-bc1c-26a01aef6e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04c9e74-244c-4ed4-9952-a06188993ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04c9e74-244c-4ed4-9952-a06188993ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-465703169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023ff416-aa4f-4113-8704-dab5b02dbf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c86ecc6cec4fab9e3f0edbdddb042d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:36Z,use_quota=True,user_id='92ee4ef419044fb98394e3c26c6df41a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc3f248-16a9-4752-bc23-b56725f2267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc3f248-16a9-4752-bc23-b56725f2267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad33406-746f-4e03-b3e1-5bdc8610a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad33406-746f-4e03-b3e1-5bdc8610a359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023ff416-aa4f-4113-8704-dab5b02dbf8a', 'volume_name': 'volume-023ff416-aa4f-4113-8704-dab5b02dbf8a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e539f-b59c-424e-8966-32c91ef6316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e539f-b59c-424e-8966-32c91ef6316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d695e78-f484-4e6b-9c7a-b9be273a746d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:36 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Volume 023ff416-aa4f-4113-8704-dab5b02dbf8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023ff416-aa4f-4113-8704-dab5b02dbf8a', 'volume_size': 1}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-465703169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023ff416-aa4f-4113-8704-dab5b02dbf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c86ecc6cec4fab9e3f0edbdddb042d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:36Z,use_quota=True,user_id='92ee4ef419044fb98394e3c26c6df41a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Creating volume 023ff416-aa4f-4113-8704-dab5b02dbf8a {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:21:36 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:21:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:36 devstack sudo[93546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a 1073741824
Nov 06 08:21:36 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:37 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a 1073741824" returned: 0 in 1.051s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:37 devstack sudo[93601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a
Nov 06 08:21:37 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:37 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a" returned: 0 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d695e78-f484-4e6b-9c7a-b9be273a746d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023ff416-aa4f-4113-8704-dab5b02dbf8a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec0afa4-601a-44a3-86b8-22ba1999aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Volume volume-023ff416-aa4f-4113-8704-dab5b02dbf8a (023ff416-aa4f-4113-8704-dab5b02dbf8a): created successfully
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec0afa4-601a-44a3-86b8-22ba1999aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Flow 'volume_create_manager' (11d31478-10ee-42bc-bc1c-26a01aef6e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:37 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1e2c697d-5742-437f-be82-9bdb1b3a7d08 tempest-VolumesServicesTestJSON-512232965 None] Created volume successfully.
Nov 06 08:21:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Acquiring lock "cinder-023ff416-aa4f-4113-8704-dab5b02dbf8a-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Lock "cinder-023ff416-aa4f-4113-8704-dab5b02dbf8a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Acquiring lock "cinder-quobyte-023ff416-aa4f-4113-8704-dab5b02dbf8a" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Lock "cinder-quobyte-023ff416-aa4f-4113-8704-dab5b02dbf8a" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9448a8-5761-4637-a056-46b2b5034010]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:39 devstack sudo[93611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a
Nov 06 08:21:39 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:39 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a" returned: 0 in 0.846s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:39 devstack sudo[93637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a
Nov 06 08:21:39 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:40 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-023ff416-aa4f-4113-8704-dab5b02dbf8a" returned: 0 in 0.707s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Lock "cinder-quobyte-023ff416-aa4f-4113-8704-dab5b02dbf8a" released by "delete_volume" :: held 1.633s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Created reservations ['a00d3631-3c5e-4314-b74a-e562268c3ce1', 'aa540e6a-5ee9-4426-afa5-bcb04247aa15', '2d724848-375c-4e27-9e15-2585cec6127f', '9454da1e-07b5-4bb3-a84a-aee98d5f3750'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:40 devstack sudo[93648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:40 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:41 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.568s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Deleted volume successfully.
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c5b42489-b24d-4932-b3ef-ee947efbb549 tempest-VolumesServicesTestJSON-512232965 None] Lock "cinder-023ff416-aa4f-4113-8704-dab5b02dbf8a-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Flow 'volume_create_manager' (2d6d0410-230f-4f32-ab0d-ddbc59e3fd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb5de0d-0667-49b8-8398-10629be72a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb5de0d-0667-49b8-8398-10629be72a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-876846999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4565760-5876-44f3-af69-6a0d5534f50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e7a9bc3143495380e35f09dd4fd4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:42Z,use_quota=True,user_id='cd5c9e5bd31a4ee89bff14cae63a0a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f9a33f-e5b9-45a3-bb45-0972f6a3ecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f9a33f-e5b9-45a3-bb45-0972f6a3ecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e4ad41-94a5-4657-a20c-4c0310099288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:21:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-8870a766-cd44-4dab-ac8e-a94f2a4af941 tempest-ServerActionsTestOtherA-502115592 None] Terminate volume connection completed successfully.
Nov 06 08:21:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-8870a766-cd44-4dab-ac8e-a94f2a4af941 tempest-ServerActionsTestOtherA-502115592 None] Deleting attachment 9b6dccc4-2ab0-483b-a0b7-e68c0c1b6b4a. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "cinder-c0a91a55-3b24-486e-94af-cf24bb9888e2-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-c0a91a55-3b24-486e-94af-cf24bb9888e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "cinder-quobyte-c0a91a55-3b24-486e-94af-cf24bb9888e2" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-quobyte-c0a91a55-3b24-486e-94af-cf24bb9888e2" acquired by "delete_volume" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda63217-5bb3-4ad3-8156-4770611bec94]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:42 devstack sudo[93668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2
Nov 06 08:21:42 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e4ad41-94a5-4657-a20c-4c0310099288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4565760-5876-44f3-af69-6a0d5534f50d', 'volume_name': 'volume-c4565760-5876-44f3-af69-6a0d5534f50d', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107045130>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324a2d29-2a0f-489d-b4ca-fc0cdf06bf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324a2d29-2a0f-489d-b4ca-fc0cdf06bf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c7f402-0e7a-4c49-a33f-d93c34957567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:42 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Volume c4565760-5876-44f3-af69-6a0d5534f50d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4565760-5876-44f3-af69-6a0d5534f50d', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107045130>}
Nov 06 08:21:42 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Trying to clone c4565760-5876-44f3-af69-6a0d5534f50d from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:21:43 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2" returned: 0 in 0.782s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:43 devstack sudo[93674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2
Nov 06 08:21:43 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:21:43 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6658d-a95e-471e-a483-1521b3176b0e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:43 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c0a91a55-3b24-486e-94af-cf24bb9888e2" returned: 0 in 0.361s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-quobyte-c0a91a55-3b24-486e-94af-cf24bb9888e2" released by "delete_volume" :: held 1.242s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:43 devstack sudo[93678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD
Nov 06 08:21:43 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG cinder.quota [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Created reservations ['f595bb03-f68c-4b7f-b18d-215aa561fc6b', 'a8da6510-70a3-4e9d-9f7e-7e2cbfc8da23', 'bed7281d-f0f1-4185-a5c7-235a8dff500a', 'd291868c-eba0-443f-9c29-c026d0147483'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:43 devstack sudo[93680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:43 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:43 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:43 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a is fetched for user cd5c9e5bd31a4ee89bff14cae63a0a11. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[713d028f-ca41-4914-aa06-f7ece115c92e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:44 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.290s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.manager [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:44 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Deleted volume successfully.
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-7226a9b2-68e8-4e4d-af1e-8835112918ce req-194c008e-4038-44d8-9e9a-4cd630199021 tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-c0a91a55-3b24-486e-94af-cf24bb9888e2-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:44 devstack sudo[93686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD
Nov 06 08:21:44 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "cinder-0d8aefe4-743e-4261-ab71-86d67626c715-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:44 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-876846999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4565760-5876-44f3-af69-6a0d5534f50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e7a9bc3143495380e35f09dd4fd4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:21:42Z,use_quota=True,user_id='cd5c9e5bd31a4ee89bff14cae63a0a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Creating volume c4565760-5876-44f3-af69-6a0d5534f50d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:21:44 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-0d8aefe4-743e-4261-ab71-86d67626c715-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:44 devstack sudo[93691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d 1073741824
Nov 06 08:21:44 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "cinder-quobyte-0d8aefe4-743e-4261-ab71-86d67626c715" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-quobyte-0d8aefe4-743e-4261-ab71-86d67626c715" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ed341-629d-4350-87c2-d492684162b8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:44 devstack sudo[93693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715
Nov 06 08:21:44 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:45 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715" returned: 0 in 0.436s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:45 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d 1073741824" returned: 0 in 0.579s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:45 devstack sudo[93702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715
Nov 06 08:21:45 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:45 devstack sudo[93704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d
Nov 06 08:21:45 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:45 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d8aefe4-743e-4261-ab71-86d67626c715" returned: 0 in 0.298s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-quobyte-0d8aefe4-743e-4261-ab71-86d67626c715" released by "delete_volume" :: held 0.783s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:45 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d" returned: 0 in 0.310s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Created reservations ['83a815bc-a5b9-40f3-8241-0c86f9ef20f6', '39aea582-3865-4601-9847-52a8549e2dc9', '92a46cc1-9b43-4657-b03e-0a757dd706df', 'd94ae3b6-4cea-4c5d-948c-a1cfc619f090'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Attempting download of b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume c4565760-5876-44f3-af69-6a0d5534f50d. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a23753a-c348-42bc-9700-3115797e3dc5]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_3fax3fag {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:45 devstack sudo[93709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:45 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:45 devstack sudo[93708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_3fax3fag
Nov 06 08:21:45 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:45 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Deleted volume successfully.
Nov 06 08:21:45 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_3fax3fag" returned: 0 in 0.414s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_3fax3fag {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8e16f232-8779-4b47-8666-b7015878e82e tempest-ServerActionsTestOtherA-502115592 None] Lock "cinder-0d8aefe4-743e-4261-ab71-86d67626c715-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:46 devstack sudo[93717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_3fax3fag
Nov 06 08:21:46 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:46 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_3fax3fag" returned: 1 in 0.640s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_3fax3fag' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb45a9-9e15-4ded-a7d6-aeb6015a6257]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:46 devstack sudo[93743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD
Nov 06 08:21:46 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:46 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] b5f6cea8-26cc-40f2-998e-90a6fcdc116a was qcow2, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:21:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:47 devstack sudo[93750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d
Nov 06 08:21:47 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:49 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d" returned: 0 in 2.843s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:49 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_x4z8wh9wdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:21:49 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Converted 112.00 MB image at 39.37 MB/s
Nov 06 08:21:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:49 devstack sudo[93761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d 1G
Nov 06 08:21:49 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:50 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d 1G" returned: 0 in 0.411s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Downloaded image b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume c4565760-5876-44f3-af69-6a0d5534f50d successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a for user cd5c9e5bd31a4ee89bff14cae63a0a11 is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Marking volume c4565760-5876-44f3-af69-6a0d5534f50d as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Copying metadata from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a to c4565760-5876-44f3-af69-6a0d5534f50d. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Creating volume glance metadata for volume c4565760-5876-44f3-af69-6a0d5534f50d backed by image b5f6cea8-26cc-40f2-998e-90a6fcdc116a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c7f402-0e7a-4c49-a33f-d93c34957567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4565760-5876-44f3-af69-6a0d5534f50d', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107045130>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849dcdd9-e592-4fa6-8fe4-659e6b40db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:21:50 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Volume volume-c4565760-5876-44f3-af69-6a0d5534f50d (c4565760-5876-44f3-af69-6a0d5534f50d): created successfully
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849dcdd9-e592-4fa6-8fe4-659e6b40db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:21:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Flow 'volume_create_manager' (2d6d0410-230f-4f32-ab0d-ddbc59e3fd2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:21:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-86f02302-797d-4475-b3ff-78378e0bea49 tempest-VolumesImageMetadata-216156564 None] Created volume successfully.
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Acquiring lock "cinder-c4565760-5876-44f3-af69-6a0d5534f50d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Lock "cinder-c4565760-5876-44f3-af69-6a0d5534f50d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Acquiring lock "cinder-quobyte-c4565760-5876-44f3-af69-6a0d5534f50d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Lock "cinder-quobyte-c4565760-5876-44f3-af69-6a0d5534f50d" acquired by "delete_volume" :: waited 0.047s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[168a185d-aeee-494f-afe9-cd8dde475387]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:51 devstack sudo[93767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d
Nov 06 08:21:51 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:51 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d" returned: 0 in 0.412s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:51 devstack sudo[93773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d
Nov 06 08:21:51 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:52 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c4565760-5876-44f3-af69-6a0d5534f50d" returned: 0 in 0.313s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Lock "cinder-quobyte-c4565760-5876-44f3-af69-6a0d5534f50d" released by "delete_volume" :: held 0.808s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Created reservations ['8edd1df8-10e8-48c0-8f34-189b4cecde30', '39853094-20d9-4c56-8594-a596d6c26296', '34635683-aa30-422d-b3cc-d3b1ad93941e', '2aa541a0-d45b-4725-87d2-fa6db47701d3'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:52 devstack sudo[93776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:52 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:52 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.379s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Deleted volume successfully.
Nov 06 08:21:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c534c9d7-2348-406e-8008-b40a5870178b tempest-VolumesImageMetadata-216156564 None] Lock "cinder-c4565760-5876-44f3-af69-6a0d5534f50d-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Acquiring lock "cinder-76624209-9008-48e1-8d29-e76d20d4825a-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Lock "cinder-76624209-9008-48e1-8d29-e76d20d4825a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Acquiring lock "cinder-quobyte-76624209-9008-48e1-8d29-e76d20d4825a" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Lock "cinder-quobyte-76624209-9008-48e1-8d29-e76d20d4825a" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3339c3-a10e-441a-a44c-8305a9462200]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:55 devstack sudo[93779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a
Nov 06 08:21:55 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:55 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a" returned: 0 in 0.489s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:55 devstack sudo[93785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a
Nov 06 08:21:55 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:56 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-76624209-9008-48e1-8d29-e76d20d4825a" returned: 0 in 0.284s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Lock "cinder-quobyte-76624209-9008-48e1-8d29-e76d20d4825a" released by "delete_volume" :: held 0.835s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Created reservations ['20aedc7e-8bb6-4613-b504-9474698dd93d', '64dd96ba-1912-4440-8d98-de9bf6bce1c6', 'ef60fed6-199e-4062-83b2-2a10e3e6ed5d', '6ae13d8f-2a42-42e5-a3fc-cd040b1f68e6'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:21:56 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:21:56 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:21:56 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.332s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:21:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Deleted volume successfully.
Nov 06 08:21:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de5f6a12-d7e5-4ee7-8d2d-14276d164dc6 tempest-VolumesNegativeTest-602981087 None] Lock "cinder-76624209-9008-48e1-8d29-e76d20d4825a-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Flow 'volume_create_manager' (40d54462-5f1c-420f-a29f-9a4e85f05765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5857d803-5829-4792-a381-2c0aa4965581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5857d803-5829-4792-a381-2c0aa4965581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-94440944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf722d82-5bc2-4bed-baa5-a1a311f19668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db0cf96799845cf9831f3265a79f172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:03Z,use_quota=True,user_id='8e430374e3e548c88a74e3c4b4230204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5f1289-a228-476b-9b37-510dc1b5feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5f1289-a228-476b-9b37-510dc1b5feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cc4bdb-3e96-4f31-bd85-d6461827844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cc4bdb-3e96-4f31-bd85-d6461827844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf722d82-5bc2-4bed-baa5-a1a311f19668', 'volume_name': 'volume-bf722d82-5bc2-4bed-baa5-a1a311f19668', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c38b579-8016-4fab-8d65-71f05dcef8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c38b579-8016-4fab-8d65-71f05dcef8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc38111-0853-4bb8-a950-f16ec6bd7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:03 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Volume bf722d82-5bc2-4bed-baa5-a1a311f19668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf722d82-5bc2-4bed-baa5-a1a311f19668', 'volume_size': 1}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-94440944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf722d82-5bc2-4bed-baa5-a1a311f19668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db0cf96799845cf9831f3265a79f172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:03Z,use_quota=True,user_id='8e430374e3e548c88a74e3c4b4230204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Creating volume bf722d82-5bc2-4bed-baa5-a1a311f19668 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:22:03 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:03 devstack sudo[93830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668 1073741824
Nov 06 08:22:03 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:03 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668 1073741824" returned: 0 in 0.558s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:04 devstack sudo[93836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668
Nov 06 08:22:04 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:04 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668" returned: 0 in 0.346s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc38111-0853-4bb8-a950-f16ec6bd7880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf722d82-5bc2-4bed-baa5-a1a311f19668', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e50ee87-dace-4aff-9249-5bd17b4d0fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:04 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Volume volume-bf722d82-5bc2-4bed-baa5-a1a311f19668 (bf722d82-5bc2-4bed-baa5-a1a311f19668): created successfully
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e50ee87-dace-4aff-9249-5bd17b4d0fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Flow 'volume_create_manager' (40d54462-5f1c-420f-a29f-9a4e85f05765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:04 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bfe52a25-b265-41d7-9e4e-812690b24aea tempest-VolumesTransfersV357Test-1112033864 None] Created volume successfully.
Nov 06 08:22:06 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cea622ec-8bff-4d70-870e-83ae5fda125e tempest-VolumesTransfersV357Test-1754749730 None] Transfer volume completed successfully.
Nov 06 08:22:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Acquiring lock "cinder-bf722d82-5bc2-4bed-baa5-a1a311f19668-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-bf722d82-5bc2-4bed-baa5-a1a311f19668-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=104,cinder:INSERT=46,cinder:UPDATE=119,cinder:DELETE=7 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:INSERT=30,cinder:UPDATE=132,cinder:SELECT=94,cinder:DELETE=12 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Acquiring lock "cinder-quobyte-bf722d82-5bc2-4bed-baa5-a1a311f19668" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-quobyte-bf722d82-5bc2-4bed-baa5-a1a311f19668" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5eda61-6bf5-4fea-975d-9fe38b7e9bd3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:07 devstack sudo[93842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668
Nov 06 08:22:07 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:07 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668" returned: 0 in 0.390s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:07 devstack sudo[93847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668
Nov 06 08:22:07 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:07 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf722d82-5bc2-4bed-baa5-a1a311f19668" returned: 0 in 0.290s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-quobyte-bf722d82-5bc2-4bed-baa5-a1a311f19668" released by "delete_volume" :: held 0.746s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Created reservations ['cbc294dd-f29a-43c3-8e1e-1a4a55e3c873', '40145aff-d4e5-4356-845a-82fb0444ce92', 'fa72c187-45ce-4073-b455-925094b7be4f', 'a5e7faa5-7e07-45f2-9902-d36f488b770a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:08 devstack sudo[93850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:22:08 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:08 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.372s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:22:08 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Deleted volume successfully.
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-827248af-2293-49d1-8483-bc4f36c3d61b tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-bf722d82-5bc2-4bed-baa5-a1a311f19668-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Flow 'volume_create_manager' (92125b8e-bd42-4918-a49c-21b6fec285b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933fd9ab-bbc4-4f90-9d15-681b9d4d9ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933fd9ab-bbc4-4f90-9d15-681b9d4d9ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1849742788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1dffc0-e7c0-4af0-af5a-41cca0325792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db0cf96799845cf9831f3265a79f172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:09Z,use_quota=True,user_id='8e430374e3e548c88a74e3c4b4230204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7c0fb0-c101-434f-a01e-1532dc5ac71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7c0fb0-c101-434f-a01e-1532dc5ac71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f87d4f-5b74-4cac-88c2-228576ddfd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f87d4f-5b74-4cac-88c2-228576ddfd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1dffc0-e7c0-4af0-af5a-41cca0325792', 'volume_name': 'volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74de2d6f-5865-4242-894b-9a3d2a5ff2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74de2d6f-5865-4242-894b-9a3d2a5ff2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d79ed52-c467-410e-bb56-98e36ecb3dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:08 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Volume bf1dffc0-e7c0-4af0-af5a-41cca0325792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792', 'volume_size': 1}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1849742788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1dffc0-e7c0-4af0-af5a-41cca0325792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db0cf96799845cf9831f3265a79f172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:09Z,use_quota=True,user_id='8e430374e3e548c88a74e3c4b4230204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Creating volume bf1dffc0-e7c0-4af0-af5a-41cca0325792 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:22:08 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:22:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:09 devstack sudo[93853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792 1073741824
Nov 06 08:22:09 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:09 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792 1073741824" returned: 0 in 0.557s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:09 devstack sudo[93859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792
Nov 06 08:22:09 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:09 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792" returned: 0 in 0.282s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d79ed52-c467-410e-bb56-98e36ecb3dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45ad833-9d64-4d37-a55e-e9a8f4909f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:09 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Volume volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792 (bf1dffc0-e7c0-4af0-af5a-41cca0325792): created successfully
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45ad833-9d64-4d37-a55e-e9a8f4909f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Flow 'volume_create_manager' (92125b8e-bd42-4918-a49c-21b6fec285b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cda2b917-9a3d-4b50-a6b9-e814c96bc280 tempest-VolumesTransfersV357Test-1112033864 None] Created volume successfully.
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Acquiring lock "cinder-bf1dffc0-e7c0-4af0-af5a-41cca0325792-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-bf1dffc0-e7c0-4af0-af5a-41cca0325792-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Acquiring lock "cinder-quobyte-bf1dffc0-e7c0-4af0-af5a-41cca0325792" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-quobyte-bf1dffc0-e7c0-4af0-af5a-41cca0325792" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d74c7d8-6e0d-4b4e-97ac-867e96e1cb28]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:11 devstack sudo[93868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792
Nov 06 08:22:11 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:11 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792" returned: 0 in 0.428s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:11 devstack sudo[93873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792
Nov 06 08:22:11 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:12 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bf1dffc0-e7c0-4af0-af5a-41cca0325792" returned: 0 in 0.291s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-quobyte-bf1dffc0-e7c0-4af0-af5a-41cca0325792" released by "delete_volume" :: held 0.770s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Created reservations ['2cb81d0a-c4c9-4b50-8d96-351e068f2a58', 'd130c8b4-3923-4941-847f-f8f5d0586f68', 'bb60c752-4d64-4d5f-ade5-c9c69b94d1f6', '492bb100-3e5a-4655-8d15-d655c43d198a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:12 devstack sudo[93876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:22:12 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:12 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.379s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:22:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Deleted volume successfully.
Nov 06 08:22:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-79817493-2a80-4b70-9845-e68a5d599833 tempest-VolumesTransfersV357Test-1139860262 None] Lock "cinder-bf1dffc0-e7c0-4af0-af5a-41cca0325792-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:22 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:22:24 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:22:27 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:22:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Flow 'volume_create_manager' (5aa54e26-0d39-490a-8d68-5f18c932077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d96cdd-e645-4578-94a7-29f52d66cb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d96cdd-e645-4578-94a7-29f52d66cb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-978676605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada671c4-74a4-42cf-8c73-3d7593c4c56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e13d73f6924ed5a679cef426d3147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:28Z,use_quota=True,user_id='7e80267a364c42e0a415724e9d1dfda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199581ad-9c2c-4d9e-b3f4-3508e2ed74a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199581ad-9c2c-4d9e-b3f4-3508e2ed74a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c4a88e-cbaf-49ee-9f39-f6019ed412e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c4a88e-cbaf-49ee-9f39-f6019ed412e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada671c4-74a4-42cf-8c73-3d7593c4c56e', 'volume_name': 'volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5607b6a9-9fda-4978-8c3e-df1d267c7b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5607b6a9-9fda-4978-8c3e-df1d267c7b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8819e035-ecca-4e68-be4e-65cc325a4929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:28 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Volume ada671c4-74a4-42cf-8c73-3d7593c4c56e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e', 'volume_size': 1}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-978676605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada671c4-74a4-42cf-8c73-3d7593c4c56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e13d73f6924ed5a679cef426d3147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:28Z,use_quota=True,user_id='7e80267a364c42e0a415724e9d1dfda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Creating volume ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:22:28 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:28 devstack sudo[93924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e 1073741824
Nov 06 08:22:28 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:28 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e 1073741824" returned: 0 in 0.633s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:28 devstack sudo[93937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e
Nov 06 08:22:28 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:29 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e" returned: 0 in 0.307s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:22:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8819e035-ecca-4e68-be4e-65cc325a4929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94812cce-7598-4652-8bcd-82411fdd0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:29 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Volume volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e (ada671c4-74a4-42cf-8c73-3d7593c4c56e): created successfully
Nov 06 08:22:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94812cce-7598-4652-8bcd-82411fdd0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Flow 'volume_create_manager' (5aa54e26-0d39-490a-8d68-5f18c932077e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c2f2e5c8-b605-41c6-9eca-834947fa9f3c tempest-VolumesCloneTest-801742503 None] Created volume successfully.
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:30 devstack sudo[93940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:22:30 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:22:30 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Flow 'volume_create_manager' (0eb73534-6e98-4446-b406-bab8d063bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07be1552-b517-4c1b-bfb9-260faba3939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.364s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07be1552-b517-4c1b-bfb9-260faba3939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-231901390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22232662-74f8-4269-b780-ca45adcb5210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e13d73f6924ed5a679cef426d3147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=ada671c4-74a4-42cf-8c73-3d7593c4c56e,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:31Z,use_quota=True,user_id='7e80267a364c42e0a415724e9d1dfda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ae66de-3cb2-4586-a0c4-31b9a6e53233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ae66de-3cb2-4586-a0c4-31b9a6e53233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb53d2f5-cf1c-4154-abef-35d8feae085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb53d2f5-cf1c-4154-abef-35d8feae085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22232662-74f8-4269-b780-ca45adcb5210', 'volume_name': 'volume-22232662-74f8-4269-b780-ca45adcb5210', 'volume_size': 2, 'source_volid': 'ada671c4-74a4-42cf-8c73-3d7593c4c56e', 'source_volstatus': 'available'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa922ae-37ab-41ec-831a-8c204b13ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa922ae-37ab-41ec-831a-8c204b13ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3184f5-08db-4ef4-902c-e42ff9e3f72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:30 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Volume 22232662-74f8-4269-b780-ca45adcb5210: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22232662-74f8-4269-b780-ca45adcb5210', 'volume_size': 2, 'source_volid': 'ada671c4-74a4-42cf-8c73-3d7593c4c56e', 'source_volstatus': 'available'}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:30 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Cloning volume ada671c4-74a4-42cf-8c73-3d7593c4c56e to volume 22232662-74f8-4269-b780-ca45adcb5210
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Creating offline snapshot f87e27b4-9a2f-43a5-b622-6e1487592cc7 of volume ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e657a0-51ed-49d3-b005-c125ee40928c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:31 devstack sudo[93943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e
Nov 06 08:22:31 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:31 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e" returned: 0 in 0.544s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:31 devstack sudo[93949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 1G
Nov 06 08:22:31 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:32 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 1G" returned: 0 in 0.759s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:32 devstack sudo[93958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7
Nov 06 08:22:32 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:33 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7" returned: 0 in 0.785s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:33 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 is being set with open permissions: ugo+rw
Nov 06 08:22:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:33 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7
Nov 06 08:22:33 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:33 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7" returned: 0 in 0.564s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:33 devstack sudo[94024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.info
Nov 06 08:22:33 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:34 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.info" returned: 0 in 0.518s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:34 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.info is being set with open permissions: ugo+rw
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:34 devstack sudo[94035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.info
Nov 06 08:22:34 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:34 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.info" returned: 0 in 0.524s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Acquiring lock "cinder-quobyte-22232662-74f8-4269-b780-ca45adcb5210" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-22232662-74f8-4269-b780-ca45adcb5210" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] snapshot: f87e27b4-9a2f-43a5-b622-6e1487592cc7, volume: 22232662-74f8-4269-b780-ca45adcb5210,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[41174a1f-ab2e-4ec2-9b6d-964498bf0d04]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:35 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7
Nov 06 08:22:35 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:36 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7" returned: 0 in 1.288s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:22:36 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704b987-1d51-4b8c-8332-fafa27bd489f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:36 devstack sudo[94121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e
Nov 06 08:22:36 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:37 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e" returned: 0 in 0.894s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:22:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:22:37 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:22:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:37 devstack sudo[94129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210
Nov 06 08:22:37 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:43 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:22:43 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (ed36b904-4c49-4c99-9d2a-bee8d9774801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6eb91b6-c9cd-47d2-b334-b46812b91ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6eb91b6-c9cd-47d2-b334-b46812b91ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1109648407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fe0c8c-608a-405c-aa58-827b3496e65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:48Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1d7513-76b5-4be7-9d77-617d82b89801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1d7513-76b5-4be7-9d77-617d82b89801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8456cf43-fb0e-4fe8-aec0-ee2f2f4ad9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8456cf43-fb0e-4fe8-aec0-ee2f2f4ad9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8fe0c8c-608a-405c-aa58-827b3496e65b', 'volume_name': 'volume-c8fe0c8c-608a-405c-aa58-827b3496e65b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134e3098-39de-4d16-92c2-1f474740d28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134e3098-39de-4d16-92c2-1f474740d28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c29124b-1504-409d-9616-82a5106e8f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Volume c8fe0c8c-608a-405c-aa58-827b3496e65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8fe0c8c-608a-405c-aa58-827b3496e65b', 'volume_size': 1}
Nov 06 08:22:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:52 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210" returned: 0 in 15.060s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e, size 1024.00 MB, duration 15.06 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:22:52 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Converted 1024.00 MB image at 67.99 MB/s
Nov 06 08:22:52 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210 is being set with open permissions: ugo+rw
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:52 devstack sudo[94220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210
Nov 06 08:22:52 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:52 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210" returned: 0 in 0.508s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-22232662-74f8-4269-b780-ca45adcb5210" released by "_copy_volume_from_snapshot" :: held 17.986s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Acquiring lock "cinder-quobyte-f87e27b4-9a2f-43a5-b622-6e1487592cc7" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-f87e27b4-9a2f-43a5-b622-6e1487592cc7" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Deleting offline snapshot f87e27b4-9a2f-43a5-b622-6e1487592cc7 of volume ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] snapshot_file for this snap is: volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a82ad-5ec0-44a9-9ec7-505169daf4e0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:52 devstack sudo[94249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7
Nov 06 08:22:52 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:53 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7" returned: 0 in 0.524s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:22:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb49d563-d429-4be4-97e3-087d5102dde2]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:53 devstack sudo[94255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e
Nov 06 08:22:53 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:54 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e" returned: 0 in 0.823s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:54 devstack sudo[94263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7
Nov 06 08:22:54 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:54 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7" returned: 0 in 0.459s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:54 devstack sudo[94269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7
Nov 06 08:22:54 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:55 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e.f87e27b4-9a2f-43a5-b622-6e1487592cc7" returned: 0 in 0.302s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-f87e27b4-9a2f-43a5-b622-6e1487592cc7" released by "_delete_snapshot" :: held 2.296s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.322s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.204s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1109648407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fe0c8c-608a-405c-aa58-827b3496e65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:22:48Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Creating volume c8fe0c8c-608a-405c-aa58-827b3496e65b {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:22:55 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3184f5-08db-4ef4-902c-e42ff9e3f72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22232662-74f8-4269-b780-ca45adcb5210', 'volume_size': 2, 'source_volid': 'ada671c4-74a4-42cf-8c73-3d7593c4c56e', 'source_volstatus': 'available'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3cc02b-2b8c-4f6a-bfe3-0160c806cf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:55 devstack sudo[94275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b 1073741824
Nov 06 08:22:55 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:55 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Volume volume-22232662-74f8-4269-b780-ca45adcb5210 (22232662-74f8-4269-b780-ca45adcb5210): created successfully
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3cc02b-2b8c-4f6a-bfe3-0160c806cf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Flow 'volume_create_manager' (0eb73534-6e98-4446-b406-bab8d063bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2bc62daf-46c4-443b-9d53-e7c38cb65f8e tempest-VolumesCloneTest-801742503 None] Created volume successfully.
Nov 06 08:22:55 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b 1073741824" returned: 0 in 0.745s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:56 devstack sudo[94282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b
Nov 06 08:22:56 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Acquiring lock "cinder-22232662-74f8-4269-b780-ca45adcb5210-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Lock "cinder-22232662-74f8-4269-b780-ca45adcb5210-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Acquiring lock "cinder-quobyte-22232662-74f8-4269-b780-ca45adcb5210" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-22232662-74f8-4269-b780-ca45adcb5210" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:56 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b" returned: 0 in 0.739s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9836b314-ba4a-40df-8b85-307b15f45b7b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c29124b-1504-409d-9616-82a5106e8f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8fe0c8c-608a-405c-aa58-827b3496e65b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff183b90-510d-4a56-8cbf-999addd88115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:22:56 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Volume volume-c8fe0c8c-608a-405c-aa58-827b3496e65b (c8fe0c8c-608a-405c-aa58-827b3496e65b): created successfully
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff183b90-510d-4a56-8cbf-999addd88115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:22:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (ed36b904-4c49-4c99-9d2a-bee8d9774801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:22:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-38e6a2f4-292a-43e5-a718-b4e7d4ebb599 tempest-VolumesActionsTest-1726823350 None] Created volume successfully.
Nov 06 08:22:57 devstack sudo[94287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210
Nov 06 08:22:57 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a05577e4-594f-4ba7-941e-c3fdf24e244a tempest-VolumesActionsTest-1726823350 None] Acquiring lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b" by "attach_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:57 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a05577e4-594f-4ba7-941e-c3fdf24e244a tempest-VolumesActionsTest-1726823350 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b" acquired by "attach_volume" :: waited 0.058s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210" returned: 0 in 0.859s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:57 devstack sudo[94300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210
Nov 06 08:22:57 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a05577e4-594f-4ba7-941e-c3fdf24e244a tempest-VolumesActionsTest-1726823350 None] Attaching volume c8fe0c8c-608a-405c-aa58-827b3496e65b to instance 5bd089cd-b4fe-4eec-9fb3-75cd863cd4aa at mountpoint /dev/vdb on host None.
Nov 06 08:22:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a05577e4-594f-4ba7-941e-c3fdf24e244a tempest-VolumesActionsTest-1726823350 None] Attach volume completed successfully.
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a05577e4-594f-4ba7-941e-c3fdf24e244a tempest-VolumesActionsTest-1726823350 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b" released by "attach_volume" :: held 0.397s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:58 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-22232662-74f8-4269-b780-ca45adcb5210" returned: 0 in 0.611s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-22232662-74f8-4269-b780-ca45adcb5210" released by "delete_volume" :: held 1.574s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Created reservations ['264df750-afef-4b06-9082-1e8eee97ab89', 'd46e18fa-c463-411e-b65e-c4bf465fbb1d', '5ebf0222-977f-46cb-a23c-c14c40aeb3a1', '38184f9f-dd0b-4ea6-82ab-eb31ffca06d3'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:22:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:58 devstack sudo[94313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:22:58 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:22:59 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.571s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:22:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Deleted volume successfully.
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Acquiring lock "cinder-ada671c4-74a4-42cf-8c73-3d7593c4c56e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ee3afc14-4e1f-47d9-a2d9-0297f3f634c7 tempest-VolumesCloneTest-801742503 None] Lock "cinder-22232662-74f8-4269-b780-ca45adcb5210-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Lock "cinder-ada671c4-74a4-42cf-8c73-3d7593c4c56e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Acquiring lock "cinder-quobyte-ada671c4-74a4-42cf-8c73-3d7593c4c56e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-ada671c4-74a4-42cf-8c73-3d7593c4c56e" acquired by "delete_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4fd8f-6188-4556-8160-4499ec885888]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:22:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:22:59 devstack sudo[94338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e
Nov 06 08:22:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-262ce705-90eb-4629-9490-bc0db0909179 tempest-VolumesActionsTest-581652966 None] Terminate volume connection completed successfully.
Nov 06 08:22:59 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-262ce705-90eb-4629-9490-bc0db0909179 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-detach_volume" by "detach_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-262ce705-90eb-4629-9490-bc0db0909179 tempest-VolumesActionsTest-581652966 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-262ce705-90eb-4629-9490-bc0db0909179 tempest-VolumesActionsTest-581652966 None] Detaching volume c8fe0c8c-608a-405c-aa58-827b3496e65b from instance 5bd089cd-b4fe-4eec-9fb3-75cd863cd4aa.
Nov 06 08:23:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-262ce705-90eb-4629-9490-bc0db0909179 tempest-VolumesActionsTest-581652966 None] Detach volume completed successfully.
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-262ce705-90eb-4629-9490-bc0db0909179 tempest-VolumesActionsTest-581652966 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-detach_volume" released by "detach_volume" :: held 0.160s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15b585a8-07aa-44c5-8c6a-cba44797c8a7 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-detach_volume" by "detach_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:00 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e" returned: 0 in 0.873s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15b585a8-07aa-44c5-8c6a-cba44797c8a7 tempest-VolumesActionsTest-1726823350 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-15b585a8-07aa-44c5-8c6a-cba44797c8a7 tempest-VolumesActionsTest-1726823350 None] Volume detach called, but volume not attached.
Nov 06 08:23:00 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e
Nov 06 08:23:00 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-15b585a8-07aa-44c5-8c6a-cba44797c8a7 tempest-VolumesActionsTest-1726823350 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:01 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ada671c4-74a4-42cf-8c73-3d7593c4c56e" returned: 0 in 0.974s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Lock "cinder-quobyte-ada671c4-74a4-42cf-8c73-3d7593c4c56e" released by "delete_volume" :: held 2.065s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "cinder-quobyte-c8fe0c8c-608a-405c-aa58-827b3496e65b" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Lock "cinder-quobyte-c8fe0c8c-608a-405c-aa58-827b3496e65b" acquired by "delete_volume" :: waited 0.075s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7bd440-5a13-49cc-854b-670e31dadedc]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Created reservations ['06017a7a-c0af-4bd3-9966-6a3e5ee7b5cc', '461fd570-7df9-436a-a93c-9e9b3700356f', 'bfadeb40-0be9-47e1-84ea-e6e64b576791', '21de9ed5-7379-4e66-926c-58c941575bf7'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:02 devstack sudo[94412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b
Nov 06 08:23:02 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:02 devstack sudo[94417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:02 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:02 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b" returned: 0 in 0.815s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:02 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.501s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Deleted volume successfully.
Nov 06 08:23:02 devstack sudo[94426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b
Nov 06 08:23:02 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-17503454-8f17-4129-85c5-7c81b7651670 tempest-VolumesCloneTest-801742503 None] Lock "cinder-ada671c4-74a4-42cf-8c73-3d7593c4c56e-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:03 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c8fe0c8c-608a-405c-aa58-827b3496e65b" returned: 0 in 0.469s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Lock "cinder-quobyte-c8fe0c8c-608a-405c-aa58-827b3496e65b" released by "delete_volume" :: held 1.410s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Created reservations ['e080cfca-e081-45e1-a304-b384e9e2b73e', '8b3de1c2-443a-41b5-9831-9f3a553a75cc', '819fcd82-dfaa-4dc5-8464-6b11e7ca631d', '447e0282-3d52-4480-85af-fc29be69764f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:03 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:03 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Flow 'volume_create_manager' (bb437f31-52ac-468e-81e0-1a69e144220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6cbcc6-aec5-4746-bbe7-ac6e0433c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:04 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.766s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6cbcc6-aec5-4746-bbe7-ac6e0433c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-937163965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bda302-ec88-4b99-af0b-d040c0872e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a2202efede4bbdb4fb485794135262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:04Z,use_quota=True,user_id='4090e92dd91e470a868697445fa74abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba132c17-5f5f-4d31-b672-bc151ee66bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba132c17-5f5f-4d31-b672-bc151ee66bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f8d076-d6be-4449-9246-bfb36176235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f8d076-d6be-4449-9246-bfb36176235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06bda302-ec88-4b99-af0b-d040c0872e00', 'volume_name': 'volume-06bda302-ec88-4b99-af0b-d040c0872e00', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5fd9a2-173d-49e5-88e5-b93f39a0246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5fd9a2-173d-49e5-88e5-b93f39a0246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a7b4a3-e0a5-4fea-81d5-da1996c84760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:04 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Volume 06bda302-ec88-4b99-af0b-d040c0872e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06bda302-ec88-4b99-af0b-d040c0872e00', 'volume_size': 1}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-937163965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bda302-ec88-4b99-af0b-d040c0872e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a2202efede4bbdb4fb485794135262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:04Z,use_quota=True,user_id='4090e92dd91e470a868697445fa74abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Creating volume 06bda302-ec88-4b99-af0b-d040c0872e00 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:04 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:04 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Deleted volume successfully.
Nov 06 08:23:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a205e052-1ca9-40a2-91e5-ab5edfbd9868 tempest-VolumesActionsTest-1726823350 None] Lock "cinder-c8fe0c8c-608a-405c-aa58-827b3496e65b-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:04 devstack sudo[94434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00 1073741824
Nov 06 08:23:04 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:06 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00 1073741824" returned: 0 in 1.697s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:06 devstack sudo[94518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00
Nov 06 08:23:06 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:07 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00" returned: 0 in 0.771s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] <== create_volume: return (2604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.616s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a7b4a3-e0a5-4fea-81d5-da1996c84760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06bda302-ec88-4b99-af0b-d040c0872e00', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643a491a-a859-4e85-aded-6a981f86e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:07 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Volume volume-06bda302-ec88-4b99-af0b-d040c0872e00 (06bda302-ec88-4b99-af0b-d040c0872e00): created successfully
Nov 06 08:23:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643a491a-a859-4e85-aded-6a981f86e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Flow 'volume_create_manager' (bb437f31-52ac-468e-81e0-1a69e144220e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c8bf9d31-03e3-46ae-aa9b-5d73fbd1a360 tempest-ServerRescueNegativeTestJSON-1949905605 None] Created volume successfully.
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (abd42ec4-1d30-401f-9b46-c053d016c5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ab5980-f95e-4cc0-ab0b-336ef8532a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ab5980-f95e-4cc0-ab0b-336ef8532a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051052453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2fc907-d5ff-4a48-b59c-cbbc8493bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:12Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a2fb88-10ae-4210-91e0-c72f26f592df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a2fb88-10ae-4210-91e0-c72f26f592df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60576783-7c55-43e4-aaba-4118e7a78438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60576783-7c55-43e4-aaba-4118e7a78438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2fc907-d5ff-4a48-b59c-cbbc8493bb01', 'volume_name': 'volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12284707-e5ed-4f4a-b21f-78dc91b2d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12284707-e5ed-4f4a-b21f-78dc91b2d845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c03b2d7-0f62-4aeb-9fb6-617ee52fabf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Volume 9f2fc907-d5ff-4a48-b59c-cbbc8493bb01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01', 'volume_size': 1}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051052453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2fc907-d5ff-4a48-b59c-cbbc8493bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:12Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Creating volume 9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:12 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:12 devstack sudo[94573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 1073741824
Nov 06 08:23:12 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Flow 'volume_create_manager' (277dc107-80e3-40fd-b731-b7dae0090e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad67c8be-e7ba-4d36-bd23-58693d5e9d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad67c8be-e7ba-4d36-bd23-58693d5e9d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1354830249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f926ba4-c37a-47c1-870f-231b7fe3b151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63c6c13e85d4c04924a8ef8765e90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:13Z,use_quota=True,user_id='56e3ac23bcaf44daa170509f64a3a9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb8ea8f-2127-44b9-ad69-7dea3638915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:13 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb8ea8f-2127-44b9-ad69-7dea3638915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6efcc75-72b6-4949-9375-876711abf284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6efcc75-72b6-4949-9375-876711abf284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f926ba4-c37a-47c1-870f-231b7fe3b151', 'volume_name': 'volume-4f926ba4-c37a-47c1-870f-231b7fe3b151', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e0816a-051d-4fc5-b7f5-2c92f4c86416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e0816a-051d-4fc5-b7f5-2c92f4c86416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be3d825-05a5-4cd4-8b26-6247d4ca650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:13 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Volume 4f926ba4-c37a-47c1-870f-231b7fe3b151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f926ba4-c37a-47c1-870f-231b7fe3b151', 'volume_size': 1}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 1073741824" returned: 0 in 1.153s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:13 devstack sudo[94586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01
Nov 06 08:23:13 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:14 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01" returned: 0 in 1.052s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1354830249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f926ba4-c37a-47c1-870f-231b7fe3b151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63c6c13e85d4c04924a8ef8765e90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:13Z,use_quota=True,user_id='56e3ac23bcaf44daa170509f64a3a9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Creating volume 4f926ba4-c37a-47c1-870f-231b7fe3b151 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:14 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:14 devstack sudo[94592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151 1073741824
Nov 06 08:23:14 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c03b2d7-0f62-4aeb-9fb6-617ee52fabf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a5f9f-0e99-4ff7-80e3-bad04fcd3ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Volume volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 (9f2fc907-d5ff-4a48-b59c-cbbc8493bb01): created successfully
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a5f9f-0e99-4ff7-80e3-bad04fcd3ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (abd42ec4-1d30-401f-9b46-c053d016c5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Flow 'volume_create_manager' (573dbe25-32d8-4fd6-ba84-876f12c7acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e814301-a5af-43b4-be0d-e76375c5b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-32ffb9db-94a5-44ba-ad49-fa129239761b tempest-VolumesActionsTest-1726823350 None] Created volume successfully.
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e814301-a5af-43b4-be0d-e76375c5b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-393883577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70766d8a-bcf5-44e5-88f8-a53ec2b8d53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebd26d6b52c4335ba86fad89b0e5b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:15Z,use_quota=True,user_id='03ed3d300f844a83807f86b0b023564a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96be9b6-f9af-4557-b9bf-d7fb45aafa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96be9b6-f9af-4557-b9bf-d7fb45aafa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f18960b-b3e7-40f9-9c66-424f9260b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f18960b-b3e7-40f9-9c66-424f9260b788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70766d8a-bcf5-44e5-88f8-a53ec2b8d53d', 'volume_name': 'volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc56a20>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87869a58-5b6b-453c-9bcd-9557452d76fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87869a58-5b6b-453c-9bcd-9557452d76fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b78e10-e7ea-4f1f-b40b-669ac1250773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Volume 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc56a20>}
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Trying to clone 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:23:15 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151 1073741824" returned: 0 in 1.087s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:16 devstack sudo[94615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151
Nov 06 08:23:16 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Lock "cinder-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-quobyte-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01" acquired by "delete_volume" :: waited 0.104s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f080692-b906-45d3-b09d-ea55413a7819]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:17 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151" returned: 0 in 1.156s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD, size 20.69 MB, duration 1.40 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:23:17 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Image download 20.69 MB at 14.73 MB/s
Nov 06 08:23:17 devstack sudo[94654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01
Nov 06 08:23:17 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be3d825-05a5-4cd4-8b26-6247d4ca650e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f926ba4-c37a-47c1-870f-231b7fe3b151', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eed24e-8966-438b-a451-c80179ce7e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:17 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Volume volume-4f926ba4-c37a-47c1-870f-231b7fe3b151 (4f926ba4-c37a-47c1-870f-231b7fe3b151): created successfully
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eed24e-8966-438b-a451-c80179ce7e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Flow 'volume_create_manager' (277dc107-80e3-40fd-b731-b7dae0090e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92bb757-6334-4082-bb47-92ffcc178a16]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4d414a04-3499-4427-bee4-aff290878a39 tempest-TestMinimumBasicScenario-305990238 None] Created volume successfully.
Nov 06 08:23:17 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD
Nov 06 08:23:17 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:18 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:18 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a is fetched for user 03ed3d300f844a83807f86b0b023564a. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:23:18 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01" returned: 0 in 1.404s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:18 devstack sudo[94675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01
Nov 06 08:23:18 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2932e65b-3feb-4a69-b624-6d1ab8de474e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:18 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD
Nov 06 08:23:18 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:19 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01" returned: 0 in 0.705s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01" released by "delete_volume" :: held 2.353s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Created reservations ['460333f5-1dd0-4663-bc92-fb539c14a8ca', '162ee739-74f8-4abe-84f3-bde1b42d70f7', '4f047e08-bae8-4398-925d-cc5d152b470e', '4fc040d2-9b28-4e2b-8bf8-a6197e90644f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:19 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-393883577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70766d8a-bcf5-44e5-88f8-a53ec2b8d53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebd26d6b52c4335ba86fad89b0e5b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:15Z,use_quota=True,user_id='03ed3d300f844a83807f86b0b023564a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Creating volume 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:19 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:19 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 1073741824
Nov 06 08:23:19 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:19 devstack sudo[94699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:19 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:20 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.494s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Deleted volume successfully.
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-cc2a8a00-1c24-46da-9c59-0f4e0885aef4 req-9bead0b8-bd70-4ecb-a8a6-a02d3592c709 tempest-TestMinimumBasicScenario-305990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-83dd3bdf-40fc-4342-ab23-f77996608210 tempest-VolumesActionsTest-581652966 None] Lock "cinder-9f2fc907-d5ff-4a48-b59c-cbbc8493bb01-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:20 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 1073741824" returned: 0 in 0.920s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:20 devstack sudo[94732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d
Nov 06 08:23:20 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:20 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-cc2a8a00-1c24-46da-9c59-0f4e0885aef4 req-9bead0b8-bd70-4ecb-a8a6-a02d3592c709 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.626s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-cc2a8a00-1c24-46da-9c59-0f4e0885aef4 req-9bead0b8-bd70-4ecb-a8a6-a02d3592c709 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Attempting download of b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:23:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-cc2a8a00-1c24-46da-9c59-0f4e0885aef4 req-9bead0b8-bd70-4ecb-a8a6-a02d3592c709 tempest-TestMinimumBasicScenario-305990238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-4f926ba4-c37a-47c1-870f-231b7fe3b151', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ed4c501-b777-4566-ad88-2844626c7799', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdce0b93-ad07-4b8e-b8a0-1c9e8f32bc66]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_ra9h7c6l {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (0ca11637-2cd8-417c-b075-351ca91292eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e5f102-1023-4653-939b-f38f2e0a5309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:21 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-cc2a8a00-1c24-46da-9c59-0f4e0885aef4 req-9bead0b8-bd70-4ecb-a8a6-a02d3592c709 tempest-TestMinimumBasicScenario-305990238 None] attachment_update completed successfully.
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e5f102-1023-4653-939b-f38f2e0a5309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2130256411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd6347-7f99-4c60-86e8-d57997546489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:21Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617f45cb-9644-44c3-96f8-bd9a9f3c4580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617f45cb-9644-44c3-96f8-bd9a9f3c4580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85194ec5-e5c8-4033-9f8c-4f20edf7af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85194ec5-e5c8-4033-9f8c-4f20edf7af79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bd6347-7f99-4c60-86e8-d57997546489', 'volume_name': 'volume-10bd6347-7f99-4c60-86e8-d57997546489', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091b4c8e-00d2-47e2-af1c-62377b9e0537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091b4c8e-00d2-47e2-af1c-62377b9e0537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb671a28-8116-49f3-8a79-1bc54520e3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:21 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Volume 10bd6347-7f99-4c60-86e8-d57997546489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bd6347-7f99-4c60-86e8-d57997546489', 'volume_size': 1}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2130256411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd6347-7f99-4c60-86e8-d57997546489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:21Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Creating volume 10bd6347-7f99-4c60-86e8-d57997546489 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:21 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:21 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_ra9h7c6l
Nov 06 08:23:21 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:21 devstack sudo[94739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489 1073741824
Nov 06 08:23:21 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:21 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_ra9h7c6l" returned: 0 in 0.749s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_ra9h7c6l {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:21 devstack sudo[94823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_ra9h7c6l
Nov 06 08:23:21 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:22 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:22 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489 1073741824" returned: 0 in 0.910s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_ra9h7c6l" returned: 1 in 0.515s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_ra9h7c6l' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846bf8d-766d-4d2e-bb8c-e131fe197a53]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:22 devstack sudo[95166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489
Nov 06 08:23:22 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:22 devstack sudo[95165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD
Nov 06 08:23:22 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:22 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] b5f6cea8-26cc-40f2-998e-90a6fcdc116a was qcow2, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:22 devstack sudo[95174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d
Nov 06 08:23:22 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:22 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489" returned: 0 in 0.607s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb671a28-8116-49f3-8a79-1bc54520e3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bd6347-7f99-4c60-86e8-d57997546489', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9981de-2b73-4cd7-a72c-69578e499db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Volume volume-10bd6347-7f99-4c60-86e8-d57997546489 (10bd6347-7f99-4c60-86e8-d57997546489): created successfully
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9981de-2b73-4cd7-a72c-69578e499db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (0ca11637-2cd8-417c-b075-351ca91292eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3dca6e59-ce10-4be0-bb86-6a00f6df3d85 tempest-VolumesActionsTest-1726823350 None] Created volume successfully.
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Acquiring lock "cinder-06bda302-ec88-4b99-af0b-d040c0872e00-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "cinder-06bda302-ec88-4b99-af0b-d040c0872e00-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Acquiring lock "cinder-quobyte-06bda302-ec88-4b99-af0b-d040c0872e00" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "cinder-quobyte-06bda302-ec88-4b99-af0b-d040c0872e00" acquired by "delete_volume" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d31c0-b9e1-460c-a671-5433d86a50d6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:23 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00
Nov 06 08:23:23 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-10bd6347-7f99-4c60-86e8-d57997546489-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Lock "cinder-10bd6347-7f99-4c60-86e8-d57997546489-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-quobyte-10bd6347-7f99-4c60-86e8-d57997546489" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-10bd6347-7f99-4c60-86e8-d57997546489" acquired by "delete_volume" :: waited 0.046s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[11315760-77ab-400c-9426-e28bdc72c928]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:24 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00" returned: 0 in 0.984s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:24 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00
Nov 06 08:23:24 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:24 devstack sudo[95188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489
Nov 06 08:23:24 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:24 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-06bda302-ec88-4b99-af0b-d040c0872e00" returned: 0 in 0.544s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "cinder-quobyte-06bda302-ec88-4b99-af0b-d040c0872e00" released by "delete_volume" :: held 1.626s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Created reservations ['6204fb52-8356-4c02-82fa-d3b7fa2efa94', '1b35f4c9-d5ed-45fe-9b58-bd952af5c22e', '306d0a7e-9c2f-41f0-8d58-c7fc8951bd52', '6777bba2-6e85-46cb-bd86-d53f0d19be7b'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:25 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489" returned: 0 in 1.133s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:25 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:25 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:25 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489
Nov 06 08:23:25 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:25 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-10bd6347-7f99-4c60-86e8-d57997546489" returned: 0 in 0.536s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-10bd6347-7f99-4c60-86e8-d57997546489" released by "delete_volume" :: held 1.804s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:26 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.751s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Deleted volume successfully.
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Created reservations ['49c5d380-50db-40c1-a2b5-08b12b03d488', 'd0c06a03-60c2-417d-bf0b-f51432780bf8', 'b600ba5f-800b-40d9-b935-608936f82871', '211e995a-9783-4ec7-bc49-485b20f1d58d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6901435-87e1-4f23-b042-15f2ae76b3cd tempest-ServerRescueNegativeTestJSON-1949905605 None] Lock "cinder-06bda302-ec88-4b99-af0b-d040c0872e00-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:26 devstack sudo[95237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:26 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:27 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.748s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:27 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Deleted volume successfully.
Nov 06 08:23:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9793d4a-1af4-4a0a-8efe-7b2959a7cf35 tempest-VolumesActionsTest-581652966 None] Lock "cinder-10bd6347-7f99-4c60-86e8-d57997546489-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:27 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" returned: 0 in 4.770s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:27 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_g6xhmv0sdevstack@QuobyteHD, size 112.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:23:27 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Converted 112.00 MB image at 23.47 MB/s
Nov 06 08:23:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:27 devstack sudo[95263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 1G
Nov 06 08:23:27 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (19c98741-b47e-4041-9222-65138a469ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635e35f2-3871-48bb-a03e-c272fd25986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:28 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 1G" returned: 0 in 0.752s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Downloaded image b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a for user 03ed3d300f844a83807f86b0b023564a is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Marking volume 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635e35f2-3871-48bb-a03e-c272fd25986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202627943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1feaf5a-b0a4-495d-b29a-24e8e65f0a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:28Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c02f141-50e3-4cd0-a5a1-58ed912ec9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c02f141-50e3-4cd0-a5a1-58ed912ec9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1319ba-e3e9-46e7-bf1e-c5e8c305cc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1319ba-e3e9-46e7-bf1e-c5e8c305cc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1feaf5a-b0a4-495d-b29a-24e8e65f0a47', 'volume_name': 'volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d43e84-84b2-487b-b1d3-1247812f5315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d43e84-84b2-487b-b1d3-1247812f5315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9c8aca-9c66-4592-8b25-16723a86704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:28 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Volume f1feaf5a-b0a4-495d-b29a-24e8e65f0a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47', 'volume_size': 1}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202627943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1feaf5a-b0a4-495d-b29a-24e8e65f0a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:28Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Creating volume f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:28 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Copying metadata from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a to 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Creating volume glance metadata for volume 70766d8a-bcf5-44e5-88f8-a53ec2b8d53d backed by image b5f6cea8-26cc-40f2-998e-90a6fcdc116a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:23:28 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 1073741824
Nov 06 08:23:28 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b78e10-e7ea-4f1f-b40b-669ac1250773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc56a20>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8d6803-f20f-45c7-888b-f9dc5b55e713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:28 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Volume volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d (70766d8a-bcf5-44e5-88f8-a53ec2b8d53d): created successfully
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8d6803-f20f-45c7-888b-f9dc5b55e713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Flow 'volume_create_manager' (573dbe25-32d8-4fd6-ba84-876f12c7acb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:28 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3d6125c8-a034-422f-b038-5286e830ca12 tempest-VolumesExtendTest-543682696 None] Created volume successfully.
Nov 06 08:23:29 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 1073741824" returned: 0 in 0.774s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:29 devstack sudo[95278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47
Nov 06 08:23:29 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:29 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47" returned: 0 in 0.492s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.405s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9c8aca-9c66-4592-8b25-16723a86704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6761393-b2e7-43d8-a534-9d0628dcafeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec3e699-4773-447b-8c59-6bfe8abf8b53]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:29 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Volume volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 (f1feaf5a-b0a4-495d-b29a-24e8e65f0a47): created successfully
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6761393-b2e7-43d8-a534-9d0628dcafeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (19c98741-b47e-4041-9222-65138a469ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ce323c15-3598-4d89-ba6d-c3073d917072 tempest-VolumesActionsTest-1726823350 None] Created volume successfully.
Nov 06 08:23:30 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d
Nov 06 08:23:30 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:30 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" returned: 0 in 0.601s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 2G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:30 devstack sudo[95289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:30 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d 2G" returned: 0 in 0.252s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.902s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ca03eb09-d337-44c7-abb3-8a3bbf562cec tempest-VolumesExtendTest-543682696 None] Extend volume completed successfully.
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Lock "cinder-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-quobyte-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:31 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.642s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3ab80-8175-4ddc-b917-d89594eef45c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:23:31 devstack sudo[95298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47
Nov 06 08:23:31 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:31 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47" returned: 0 in 0.484s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:31 devstack sudo[95312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47
Nov 06 08:23:31 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:32 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47" returned: 0 in 0.438s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47" released by "delete_volume" :: held 1.016s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Created reservations ['350c0405-8536-48a5-bd9e-a144e8bdc048', 'ecc30a76-ed0c-4d0d-8656-516fc4b7e79f', '0fcf2710-657d-4d99-9fe4-a22e655340b6', '26a5f597-e89d-4c96-80c8-cd10fdc98f39'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Acquiring lock "cinder-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:32 devstack sudo[95327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Lock "cinder-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:32 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Acquiring lock "cinder-quobyte-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" acquired by "delete_volume" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d69aa16-87c3-42ef-89cd-523ce24fdfb7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:32 devstack sudo[95329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d
Nov 06 08:23:32 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:32 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.461s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:32 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Deleted volume successfully.
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da549824-08f9-4adb-a3f0-b3422fc78801 tempest-VolumesActionsTest-581652966 None] Lock "cinder-f1feaf5a-b0a4-495d-b29a-24e8e65f0a47-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:32 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" returned: 0 in 0.475s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:33 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d
Nov 06 08:23:33 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:33 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" returned: 0 in 0.447s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d" released by "delete_volume" :: held 1.005s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Created reservations ['812b4b8c-4eb0-4129-b9a4-e178cdf154c8', 'a3b3c02c-d263-4d6c-b530-279ae0950c47', 'df7e25e8-c2ea-4a5e-8835-b894c758b488', '2464bf84-3f48-446e-bb14-7c457bb8002e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:33 devstack sudo[95340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:33 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:34 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.489s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Deleted volume successfully.
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (31e043e0-04d9-4b9c-86d6-4e3d8ef47951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b4240d-8502-4e47-b511-a52a5578ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b4240d-8502-4e47-b511-a52a5578ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870150197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeae761-8947-44e9-a32f-4369dc9e6373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:34Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648f98bb-f22d-4978-a863-369279c022bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648f98bb-f22d-4978-a863-369279c022bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21cd04e-134a-4a91-99ea-2b19fc7a0e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21cd04e-134a-4a91-99ea-2b19fc7a0e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edeae761-8947-44e9-a32f-4369dc9e6373', 'volume_name': 'volume-edeae761-8947-44e9-a32f-4369dc9e6373', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a8edd0-84ff-45ec-8043-5d494d567059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a8edd0-84ff-45ec-8043-5d494d567059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b41005b-a8be-48ed-b161-ef44e68bbc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Volume edeae761-8947-44e9-a32f-4369dc9e6373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edeae761-8947-44e9-a32f-4369dc9e6373', 'volume_size': 1}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870150197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeae761-8947-44e9-a32f-4369dc9e6373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:34Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Creating volume edeae761-8947-44e9-a32f-4369dc9e6373 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:34 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-394a2899-9e84-415c-b438-8c0e702cd45e tempest-VolumesExtendTest-543682696 None] Lock "cinder-70766d8a-bcf5-44e5-88f8-a53ec2b8d53d-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:34 devstack sudo[95343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373 1073741824
Nov 06 08:23:34 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:34 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373 1073741824" returned: 0 in 0.629s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:35 devstack sudo[95349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373
Nov 06 08:23:35 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:35 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373" returned: 0 in 0.653s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b41005b-a8be-48ed-b161-ef44e68bbc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edeae761-8947-44e9-a32f-4369dc9e6373', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9347b3d1-339d-4e74-b8d2-8462b58de48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Volume volume-edeae761-8947-44e9-a32f-4369dc9e6373 (edeae761-8947-44e9-a32f-4369dc9e6373): created successfully
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9347b3d1-339d-4e74-b8d2-8462b58de48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (31e043e0-04d9-4b9c-86d6-4e3d8ef47951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:35 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f89da35c-61a4-4dbb-92e5-2e32b409c7c5 tempest-VolumesActionsTest-1726823350 None] Created volume successfully.
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Flow 'volume_create_manager' (ba466d22-18d3-46db-b296-cb60492953d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e743a18-025a-4ae6-be38-f4a273afaa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e743a18-025a-4ae6-be38-f4a273afaa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1675550441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ab5d10-61a9-422a-b4f6-a3a73ec88919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebd26d6b52c4335ba86fad89b0e5b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:36Z,use_quota=True,user_id='03ed3d300f844a83807f86b0b023564a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2115ec99-299e-4eee-ba24-a2fedf7fc823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2115ec99-299e-4eee-ba24-a2fedf7fc823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15335aca-88fa-4302-acad-754a8d34518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15335aca-88fa-4302-acad-754a8d34518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ab5d10-61a9-422a-b4f6-a3a73ec88919', 'volume_name': 'volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1815c5-8c06-4510-9b3b-c368c951227e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1815c5-8c06-4510-9b3b-c368c951227e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fccbf2-f7df-48de-b238-54777277e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Volume 41ab5d10-61a9-422a-b4f6-a3a73ec88919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919', 'volume_size': 1}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1675550441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ab5d10-61a9-422a-b4f6-a3a73ec88919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebd26d6b52c4335ba86fad89b0e5b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:36Z,use_quota=True,user_id='03ed3d300f844a83807f86b0b023564a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Creating volume 41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:35 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:35 devstack sudo[95353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 1073741824
Nov 06 08:23:35 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:36 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 1073741824" returned: 0 in 0.684s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:36 devstack sudo[95362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919
Nov 06 08:23:36 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-edeae761-8947-44e9-a32f-4369dc9e6373-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Lock "cinder-edeae761-8947-44e9-a32f-4369dc9e6373-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Acquiring lock "cinder-quobyte-edeae761-8947-44e9-a32f-4369dc9e6373" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-edeae761-8947-44e9-a32f-4369dc9e6373" acquired by "delete_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[523fe36f-2148-4f2a-87f3-78bff50c077f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:37 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fccbf2-f7df-48de-b238-54777277e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ceb323-1bbb-4205-9314-6cd322bb000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Volume volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 (41ab5d10-61a9-422a-b4f6-a3a73ec88919): created successfully
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ceb323-1bbb-4205-9314-6cd322bb000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Flow 'volume_create_manager' (ba466d22-18d3-46db-b296-cb60492953d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:37 devstack sudo[95366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373
Nov 06 08:23:37 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:37 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6eb211f3-8360-4f90-bf7c-4cba1f19212f tempest-VolumesExtendTest-543682696 None] Created volume successfully.
Nov 06 08:23:37 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373" returned: 0 in 0.568s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:37 devstack sudo[95375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373
Nov 06 08:23:37 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:37 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-edeae761-8947-44e9-a32f-4369dc9e6373" returned: 0 in 0.322s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Lock "cinder-quobyte-edeae761-8947-44e9-a32f-4369dc9e6373" released by "delete_volume" :: held 0.954s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Created reservations ['3849416b-c652-4bca-bc94-8737ea9fcd6f', '774c6de6-612e-48c1-ade5-ff503594d5bc', '615164a4-31aa-41d6-9f3c-ad696603e001', 'fbde2a6d-2ad4-4b5c-9b0f-eb3508397470'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Creating offline snapshot 7e228d6a-ebd7-4d90-8b53-098336cf67df of volume 41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[181c0a19-49b7-4c65-9afe-b124e0e4127b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:38 devstack sudo[95379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:38 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:38 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919
Nov 06 08:23:38 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:38 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.327s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Deleted volume successfully.
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dbc5c20b-04d8-4f26-b88e-ef7d39095118 tempest-VolumesActionsTest-581652966 None] Lock "cinder-edeae761-8947-44e9-a32f-4369dc9e6373-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:38 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919" returned: 0 in 0.497s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:38 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df 1G
Nov 06 08:23:38 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:38 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df 1G" returned: 0 in 0.400s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:38 devstack sudo[95391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df
Nov 06 08:23:38 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:39 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df" returned: 0 in 0.416s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:39 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df is being set with open permissions: ugo+rw
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:39 devstack sudo[95396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df
Nov 06 08:23:39 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:39 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df" returned: 0 in 0.295s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:39 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.info
Nov 06 08:23:39 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (700e2aa2-1833-4351-a021-10978a16a1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9183993e-3d2f-478f-818a-a177a84e7c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9183993e-3d2f-478f-818a-a177a84e7c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1122557855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b21ca14-8a97-4edc-8abf-fb8c43ae5f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:40Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616d3904-5787-464e-92c2-f34035cb2ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616d3904-5787-464e-92c2-f34035cb2ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c802f01-5d76-4ff8-9a98-79a989f9439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c802f01-5d76-4ff8-9a98-79a989f9439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b21ca14-8a97-4edc-8abf-fb8c43ae5f67', 'volume_name': 'volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c04434-4863-4cf8-a794-68389aaba15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c04434-4863-4cf8-a794-68389aaba15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7173d3e-0890-42b6-b7b7-755340cbea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:39 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Volume 1b21ca14-8a97-4edc-8abf-fb8c43ae5f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67', 'volume_size': 1}
Nov 06 08:23:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:40 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.info" returned: 0 in 0.317s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:40 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.info is being set with open permissions: ugo+rw
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:40 devstack sudo[95402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.info
Nov 06 08:23:40 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:40 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.info" returned: 0 in 0.280s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1122557855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b21ca14-8a97-4edc-8abf-fb8c43ae5f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8257cd0599544b4b458915c1ac7d13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:40Z,use_quota=True,user_id='ace898758c0e44f995dd53e8a05e9205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Creating volume 1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:40 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:40 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 1073741824
Nov 06 08:23:40 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:40 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-43d19290-9200-4a84-8cb7-10c01e5a67cd tempest-VolumesExtendTest-543682696 None] Create snapshot completed successfully
Nov 06 08:23:40 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 1073741824" returned: 0 in 0.555s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:40 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67
Nov 06 08:23:40 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:41 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67" returned: 0 in 0.334s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7173d3e-0890-42b6-b7b7-755340cbea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528f8f57-f449-4789-b13b-79446564d93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee23e5-2dbe-4c10-8cc2-243546617df3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:41 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Volume volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 (1b21ca14-8a97-4edc-8abf-fb8c43ae5f67): created successfully
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528f8f57-f449-4789-b13b-79446564d93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Flow 'volume_create_manager' (700e2aa2-1833-4351-a021-10978a16a1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-88a31983-b279-4c98-a007-7481ddaccda4 tempest-VolumesActionsTest-1726823350 None] Created volume successfully.
Nov 06 08:23:41 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919
Nov 06 08:23:41 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:41 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919" returned: 0 in 0.433s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df 2G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df 2G" returned: 0 in 0.224s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.745s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-38589092-f172-43f6-a361-3d8de9e1c382 tempest-VolumesExtendTest-543682696 None] Extend volume completed successfully.
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Acquiring lock "cinder-7e228d6a-ebd7-4d90-8b53-098336cf67df-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Acquiring lock "cinder-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Lock "cinder-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Lock "cinder-7e228d6a-ebd7-4d90-8b53-098336cf67df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Acquiring lock "cinder-quobyte-41ab5d10-61a9-422a-b4f6-a3a73ec88919" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-41ab5d10-61a9-422a-b4f6-a3a73ec88919" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Acquiring lock "cinder-quobyte-7e228d6a-ebd7-4d90-8b53-098336cf67df" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Acquiring lock "cinder-quobyte-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-7e228d6a-ebd7-4d90-8b53-098336cf67df" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Deleting offline snapshot 7e228d6a-ebd7-4d90-8b53-098336cf67df of volume 41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] snapshot_file for this snap is: volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Lock "cinder-quobyte-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67" acquired by "delete_volume" :: waited 0.047s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c475a13-1be6-4323-81c2-079e5c2c2206]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d0811-63f9-487e-8d49-1e728f7c2ed6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:43 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67
Nov 06 08:23:43 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:43 devstack sudo[95477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df
Nov 06 08:23:43 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:43 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67" returned: 0 in 0.630s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:43 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df" returned: 0 in 0.670s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:23:43 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67
Nov 06 08:23:43 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3b5b94-d9aa-490e-8f8f-d305ee3f93e1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:43 devstack sudo[95489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919
Nov 06 08:23:43 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:44 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67" returned: 0 in 0.482s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Lock "cinder-quobyte-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67" released by "delete_volume" :: held 1.198s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=113,cinder:SELECT=86,cinder:DELETE=9,cinder:INSERT=30 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=106,cinder:UPDATE=125,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Created reservations ['c221dcbb-d5ab-4dda-a6f6-fedf5870cecf', '25345e5a-27c9-46bc-b14d-b9cc0106092b', '44f54c96-944c-48ae-ad57-76d908a92960', 'f2535dec-f721-4353-9e17-0154d4535a83'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:44 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919" returned: 0 in 0.729s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:44 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df
Nov 06 08:23:44 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:44 devstack sudo[95495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:44 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:44 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.383s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:44 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Deleted volume successfully.
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-da22e951-0891-4264-a81b-f79248985a5b tempest-VolumesActionsTest-1726823350 None] Lock "cinder-1b21ca14-8a97-4edc-8abf-fb8c43ae5f67-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:44 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df" returned: 0 in 0.577s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:44 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df
Nov 06 08:23:44 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:45 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919.7e228d6a-ebd7-4d90-8b53-098336cf67df" returned: 0 in 0.313s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-7e228d6a-ebd7-4d90-8b53-098336cf67df" released by "_delete_snapshot" :: held 2.472s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-41ab5d10-61a9-422a-b4f6-a3a73ec88919" released by "delete_snapshot" :: held 2.523s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Created reservations ['c0242c98-f6a4-426c-a71c-f16a7d106b8e', 'bafaac18-df58-4954-9760-34e514cd40e1', 'a24acbcc-ff71-42e5-8888-9dbf4b9db9d9', '2f6bd0a7-3948-4d7d-908c-feffdb1b7696'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Delete snapshot completed successfully.
Nov 06 08:23:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7fbcc04a-b36c-4bff-bf43-e8a5bc5151e0 tempest-VolumesExtendTest-543682696 None] Lock "cinder-7e228d6a-ebd7-4d90-8b53-098336cf67df-delete_snapshot" released by "delete_snapshot" :: held 2.798s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Acquiring lock "cinder-41ab5d10-61a9-422a-b4f6-a3a73ec88919-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Lock "cinder-41ab5d10-61a9-422a-b4f6-a3a73ec88919-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Acquiring lock "cinder-quobyte-41ab5d10-61a9-422a-b4f6-a3a73ec88919" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-41ab5d10-61a9-422a-b4f6-a3a73ec88919" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b70a8c2-ee96-4d2c-a27f-7702326be6ea]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:46 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919
Nov 06 08:23:46 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:46 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919" returned: 0 in 0.506s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:46 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919
Nov 06 08:23:46 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:47 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-41ab5d10-61a9-422a-b4f6-a3a73ec88919" returned: 0 in 0.311s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Lock "cinder-quobyte-41ab5d10-61a9-422a-b4f6-a3a73ec88919" released by "delete_volume" :: held 0.909s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Created reservations ['dc8d9adf-eb7f-4291-8a5e-75069d847866', '40f17732-3a54-48b5-806d-9d439afc0319', 'da166259-a2b0-4ffe-b02e-c5c79c11e1cf', '40153d3f-c5b9-428e-b614-2cffece21bbb'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:47 devstack sudo[95518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:23:47 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:47 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.277s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:23:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Deleted volume successfully.
Nov 06 08:23:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-49be1fb2-3bb0-4649-92cd-e54ed56d1234 tempest-VolumesExtendTest-543682696 None] Lock "cinder-41ab5d10-61a9-422a-b4f6-a3a73ec88919-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (f790b363-1928-4269-b309-f78b74a153ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d92bfd-bae5-44b1-9269-84a9dea504d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d92bfd-bae5-44b1-9269-84a9dea504d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-609837191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9013da-0da5-4090-b461-44bdbe69f2a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:55Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820f05a7-1aef-4ff0-bd94-d89f9833fb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820f05a7-1aef-4ff0-bd94-d89f9833fb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b56a2e-0be3-4f45-9b3f-c7f4718d6c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b56a2e-0be3-4f45-9b3f-c7f4718d6c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9013da-0da5-4090-b461-44bdbe69f2a6', 'volume_name': 'volume-de9013da-0da5-4090-b461-44bdbe69f2a6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da9fefd-0898-4620-bb7a-57eae45da608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da9fefd-0898-4620-bb7a-57eae45da608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51126ac1-9b05-4b9f-ac7f-2d857f409c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:54 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Volume de9013da-0da5-4090-b461-44bdbe69f2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9013da-0da5-4090-b461-44bdbe69f2a6', 'volume_size': 1}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-609837191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9013da-0da5-4090-b461-44bdbe69f2a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:55Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Creating volume de9013da-0da5-4090-b461-44bdbe69f2a6 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:54 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:54 devstack sudo[95524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6 1073741824
Nov 06 08:23:54 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:55 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6 1073741824" returned: 0 in 0.821s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:55 devstack sudo[95531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6
Nov 06 08:23:55 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:56 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6" returned: 0 in 0.299s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51126ac1-9b05-4b9f-ac7f-2d857f409c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9013da-0da5-4090-b461-44bdbe69f2a6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bf9f94-2305-43b9-821b-8cda13c120b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:56 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Volume volume-de9013da-0da5-4090-b461-44bdbe69f2a6 (de9013da-0da5-4090-b461-44bdbe69f2a6): created successfully
Nov 06 08:23:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bf9f94-2305-43b9-821b-8cda13c120b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (f790b363-1928-4269-b309-f78b74a153ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0edff893-2bdf-4b32-8ad5-6b47028947d2 tempest-VolumesGetTest-272500250 None] Created volume successfully.
Nov 06 08:23:57 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (ddbe2948-267f-4383-be4a-e0dd4ac7934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0235b7e6-be6f-439b-8d98-fdabaf703045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0235b7e6-be6f-439b-8d98-fdabaf703045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1260472125',display_name='tempest-VolumesGetTest-Volume-508389024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:58Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395fc946-607c-47f0-ac21-7f0f3d33cc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395fc946-607c-47f0-ac21-7f0f3d33cc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743bd99b-d6ac-4401-af93-f27ee50db9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743bd99b-d6ac-4401-af93-f27ee50db9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9', 'volume_name': 'volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff13c99c-0abb-434e-8252-54471a59e837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff13c99c-0abb-434e-8252-54471a59e837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49cb5cb-ba04-4c2b-870e-e26ae3201036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:58 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Volume 42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9', 'volume_size': 1}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:23:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1260472125',display_name='tempest-VolumesGetTest-Volume-508389024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:23:58Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Creating volume 42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:23:58 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:58 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 1073741824
Nov 06 08:23:58 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:58 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 1073741824" returned: 0 in 0.589s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:23:58 devstack sudo[95542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9
Nov 06 08:23:58 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:23:59 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root
Nov 06 08:23:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9" returned: 0 in 0.321s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:23:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:23:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:23:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49cb5cb-ba04-4c2b-870e-e26ae3201036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dce688-5824-4b17-9c97-190aa35c78e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:23:59 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Volume volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 (42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9): created successfully
Nov 06 08:23:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dce688-5824-4b17-9c97-190aa35c78e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:23:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (ddbe2948-267f-4383-be4a-e0dd4ac7934f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:23:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-07562411-286f-464d-8cac-6811d2b5eada tempest-VolumesGetTest-272500250 None] Created volume successfully.
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Lock "cinder-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[71333b65-017b-4dcd-8da0-99d3b9159f7a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:00 devstack sudo[95545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9
Nov 06 08:24:00 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:00 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9" returned: 0 in 0.427s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:00 devstack sudo[95551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9
Nov 06 08:24:00 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:01 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9" returned: 0 in 0.291s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9" released by "delete_volume" :: held 0.781s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Created reservations ['73efc299-04fc-4f80-a2e9-8fb24da18f62', '80f9bf3e-f498-4aba-8d40-73e662369d48', 'ee38df49-af66-4029-bb71-e1d77d1457ff', '7ac05471-1d9a-4934-a9fc-89d4f8a88fbe'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:01 devstack sudo[95554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:01 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-de9013da-0da5-4090-b461-44bdbe69f2a6-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:01 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.360s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Lock "cinder-de9013da-0da5-4090-b461-44bdbe69f2a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Deleted volume successfully.
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-11101103-f4a5-492f-8247-3e658bfdad32 tempest-VolumesGetTest-272500250 None] Lock "cinder-42a13ccc-d3e1-4a78-bccf-69a19c2a2ff9-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-de9013da-0da5-4090-b461-44bdbe69f2a6" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-de9013da-0da5-4090-b461-44bdbe69f2a6" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[734d0949-c272-4a87-9a70-1922f075dab6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:01 devstack sudo[95560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6
Nov 06 08:24:01 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:02 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6" returned: 0 in 0.510s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:02 devstack sudo[95565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6
Nov 06 08:24:02 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:02 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de9013da-0da5-4090-b461-44bdbe69f2a6" returned: 0 in 0.294s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-de9013da-0da5-4090-b461-44bdbe69f2a6" released by "delete_volume" :: held 0.880s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Created reservations ['f3168a30-5692-4e24-b20f-12f45fb72af9', 'e844ce34-ba46-40f6-8893-7b707acc1fcc', 'a81e24c5-6410-43c5-b763-25336f3edb25', 'f812bc32-36fd-4e01-b6c4-e6ae0a484c28'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:02 devstack sudo[95584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:02 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:03 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.348s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:03 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:03 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Deleted volume successfully.
Nov 06 08:24:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-be71c2f3-f8f0-4618-a7b1-b27f9c491697 tempest-VolumesGetTest-272500250 None] Lock "cinder-de9013da-0da5-4090-b461-44bdbe69f2a6-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (527c3776-c191-44af-a86e-46ade0e4f581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bcd42d-5fd5-4f79-bbe4-c055967344fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bcd42d-5fd5-4f79-bbe4-c055967344fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283355932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a67e44-d17d-4091-9acf-4984943756f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:05Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bd48bc-36e4-4c2e-b18a-946abceaa128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bd48bc-36e4-4c2e-b18a-946abceaa128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db1671e-5556-4761-9d77-9ad1549bd966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db1671e-5556-4761-9d77-9ad1549bd966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a67e44-d17d-4091-9acf-4984943756f3', 'volume_name': 'volume-f9a67e44-d17d-4091-9acf-4984943756f3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cd713d-1c68-44cd-8ad7-19f08e3f3b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cd713d-1c68-44cd-8ad7-19f08e3f3b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0be8d8c-7b66-469f-8b2a-68e33cec445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:04 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Volume f9a67e44-d17d-4091-9acf-4984943756f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a67e44-d17d-4091-9acf-4984943756f3', 'volume_size': 1}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283355932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a67e44-d17d-4091-9acf-4984943756f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:05Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Creating volume f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:04 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:05 devstack sudo[95628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 1073741824
Nov 06 08:24:05 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:05 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 1073741824" returned: 0 in 0.771s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Flow 'volume_create_manager' (9c2d031c-0725-4b79-bd0f-8dab0c87676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be6c082-6b25-4e3f-b475-c7ed24e2a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be6c082-6b25-4e3f-b475-c7ed24e2a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1519448756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86efda97-cb17-4383-af5a-a76ebaa57c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ee29cda006452c9711cf9e7c864b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:06Z,use_quota=True,user_id='87eb7cf72e9a4727876a666fd28a2534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276058ed-0823-4283-9243-d34246816450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276058ed-0823-4283-9243-d34246816450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c01705-b9ab-43db-b505-a6a4e340c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c01705-b9ab-43db-b505-a6a4e340c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86efda97-cb17-4383-af5a-a76ebaa57c00', 'volume_name': 'volume-86efda97-cb17-4383-af5a-a76ebaa57c00', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaec8b36-cee3-4407-8dfe-dd0e0c0c84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaec8b36-cee3-4407-8dfe-dd0e0c0c84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e149d0cb-2d58-4ee4-9a23-28aa54bbb91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:05 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Volume 86efda97-cb17-4383-af5a-a76ebaa57c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86efda97-cb17-4383-af5a-a76ebaa57c00', 'volume_size': 1}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:05 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3
Nov 06 08:24:05 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:06 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3" returned: 0 in 0.298s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1519448756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86efda97-cb17-4383-af5a-a76ebaa57c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ee29cda006452c9711cf9e7c864b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:06Z,use_quota=True,user_id='87eb7cf72e9a4727876a666fd28a2534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Creating volume 86efda97-cb17-4383-af5a-a76ebaa57c00 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:06 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0be8d8c-7b66-469f-8b2a-68e33cec445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a67e44-d17d-4091-9acf-4984943756f3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:06 devstack sudo[95641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00 1073741824
Nov 06 08:24:06 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c23d1f-d7b9-438c-8130-b14e761432d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:06 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Volume volume-f9a67e44-d17d-4091-9acf-4984943756f3 (f9a67e44-d17d-4091-9acf-4984943756f3): created successfully
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c23d1f-d7b9-438c-8130-b14e761432d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (527c3776-c191-44af-a86e-46ade0e4f581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:06 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-668ffd1f-736b-46ef-ba44-af3a9753e02d tempest-VolumesGetTest-272500250 None] Created volume successfully.
Nov 06 08:24:06 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00 1073741824" returned: 0 in 0.630s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:06 devstack sudo[95647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00
Nov 06 08:24:06 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:07 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00" returned: 0 in 0.409s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e149d0cb-2d58-4ee4-9a23-28aa54bbb91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86efda97-cb17-4383-af5a-a76ebaa57c00', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db17737-ff70-45eb-8bbf-b59c685d6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:07 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Volume volume-86efda97-cb17-4383-af5a-a76ebaa57c00 (86efda97-cb17-4383-af5a-a76ebaa57c00): created successfully
Nov 06 08:24:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db17737-ff70-45eb-8bbf-b59c685d6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Flow 'volume_create_manager' (9c2d031c-0725-4b79-bd0f-8dab0c87676e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-026a98ce-256d-4342-b1ac-e2d41098eb4a tempest-AbsoluteLimitsTests-1859865312 None] Created volume successfully.
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (7199c771-beae-4368-832b-3ad8a8490888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b39056-9799-4b03-b727-86e7a34d2c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b39056-9799-4b03-b727-86e7a34d2c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-279734458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55ffa69-1a87-4b7f-ac6f-a8e4de115a12,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f9a67e44-d17d-4091-9acf-4984943756f3,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:08Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d668f160-d732-41f8-ad74-12b488b6234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d668f160-d732-41f8-ad74-12b488b6234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f68ac8-835b-4777-9529-16e541f51fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f68ac8-835b-4777-9529-16e541f51fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd55ffa69-1a87-4b7f-ac6f-a8e4de115a12', 'volume_name': 'volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12', 'volume_size': 1, 'source_volid': 'f9a67e44-d17d-4091-9acf-4984943756f3', 'source_volstatus': 'available'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a906e246-fc7f-40c8-b315-f64e9b4805a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a906e246-fc7f-40c8-b315-f64e9b4805a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a2db4f-bc06-4d25-b30a-3c37cb641a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:08 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Volume d55ffa69-1a87-4b7f-ac6f-a8e4de115a12: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12', 'volume_size': 1, 'source_volid': 'f9a67e44-d17d-4091-9acf-4984943756f3', 'source_volstatus': 'available'}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Acquiring lock "cinder-86efda97-cb17-4383-af5a-a76ebaa57c00-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:08 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Cloning volume f9a67e44-d17d-4091-9acf-4984943756f3 to volume d55ffa69-1a87-4b7f-ac6f-a8e4de115a12
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Lock "cinder-86efda97-cb17-4383-af5a-a76ebaa57c00-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Creating offline snapshot cece0c9e-f7f4-4da9-89cf-313f866130fe of volume f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:24:08 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-993ae067-9ee3-40f3-9d73-8af5556eb8c9 req-26d9daf7-4aea-4741-a8a9-b08e5ced6307 tempest-TestMinimumBasicScenario-305990238 None] Terminate volume connection completed successfully.
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-993ae067-9ee3-40f3-9d73-8af5556eb8c9 req-26d9daf7-4aea-4741-a8a9-b08e5ced6307 tempest-TestMinimumBasicScenario-305990238 None] Deleting attachment 9ed4c501-b777-4566-ad88-2844626c7799. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee0b4c-b5bc-4bfa-9249-36a71a1fbe8e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Acquiring lock "cinder-quobyte-86efda97-cb17-4383-af5a-a76ebaa57c00" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Lock "cinder-quobyte-86efda97-cb17-4383-af5a-a76ebaa57c00" acquired by "delete_volume" :: waited 0.069s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:09 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ac4e65-c4e9-437c-92a6-7fd75e568059]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:09 devstack sudo[95719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3
Nov 06 08:24:09 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:09 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00
Nov 06 08:24:09 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:09 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00" returned: 0 in 0.721s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:09 devstack sudo[95736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00
Nov 06 08:24:09 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:09 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3" returned: 0 in 1.003s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:09 devstack sudo[95738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe 1G
Nov 06 08:24:09 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:10 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-86efda97-cb17-4383-af5a-a76ebaa57c00" returned: 0 in 0.428s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Lock "cinder-quobyte-86efda97-cb17-4383-af5a-a76ebaa57c00" released by "delete_volume" :: held 1.276s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Created reservations ['68ab850a-b429-43fc-9a12-c91b63172dae', '2f631997-2768-423f-95ce-2a98a85dc44c', '518c5d22-15bf-4728-892e-99f1e27932ae', '391c09df-377d-4658-8b48-ad04f8289f83'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:10 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:10 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Acquiring lock "cinder-4f926ba4-c37a-47c1-870f-231b7fe3b151-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Lock "cinder-4f926ba4-c37a-47c1-870f-231b7fe3b151-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:10 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe 1G" returned: 0 in 0.759s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a67e44-d17d-4091-9acf-4984943756f3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:10 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a67e44-d17d-4091-9acf-4984943756f3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe
Nov 06 08:24:10 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Acquiring lock "cinder-quobyte-4f926ba4-c37a-47c1-870f-231b7fe3b151" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:10 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Lock "cinder-quobyte-4f926ba4-c37a-47c1-870f-231b7fe3b151" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.338s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Deleted volume successfully.
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a7a9c6-f4de-4a45-9f6f-f185ecec753b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-27fcae81-aeb3-4b5a-a251-8aef8ae9ea49 tempest-AbsoluteLimitsTests-1859865312 None] Lock "cinder-86efda97-cb17-4383-af5a-a76ebaa57c00-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:10 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151
Nov 06 08:24:10 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:11 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a67e44-d17d-4091-9acf-4984943756f3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe" returned: 0 in 0.433s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:11 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe is being set with open permissions: ugo+rw
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:11 devstack sudo[95755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe
Nov 06 08:24:11 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:11 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151" returned: 0 in 0.579s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:11 devstack sudo[95766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151
Nov 06 08:24:11 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:11 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe" returned: 0 in 0.418s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:11 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.info
Nov 06 08:24:11 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:11 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f926ba4-c37a-47c1-870f-231b7fe3b151" returned: 0 in 0.515s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Lock "cinder-quobyte-4f926ba4-c37a-47c1-870f-231b7fe3b151" released by "delete_volume" :: held 1.171s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:11 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.info" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:11 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.info is being set with open permissions: ugo+rw
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:11 devstack sudo[95773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.info
Nov 06 08:24:11 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:11 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Created reservations ['0d7d0c36-38e5-4214-8a69-289e1e4861ce', '679859c4-2857-4cd2-816e-c3a3d9c2c2fd', '10477ed3-a3ad-4a95-bbb0-aee8a6629bcb', '5b0b1b79-8d04-4adb-9dc7-bcee9bfa7613'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:12 devstack sudo[95775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:12 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:12 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.info" returned: 0 in 0.371s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] snapshot: cece0c9e-f7f4-4da9-89cf-313f866130fe, volume: d55ffa69-1a87-4b7f-ac6f-a8e4de115a12,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17609f6-4e48-43a3-a242-54d1e02c8a0c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:12 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.484s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:12 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe
Nov 06 08:24:12 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Deleted volume successfully.
Nov 06 08:24:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1000be12-0c0e-4d95-95e0-8837fdf55ef3 tempest-TestMinimumBasicScenario-305990238 None] Lock "cinder-4f926ba4-c37a-47c1-870f-231b7fe3b151-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:13 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe" returned: 0 in 0.573s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9a67e44-d17d-4091-9acf-4984943756f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[113fe0d7-c1d3-4147-8562-269b346ad867]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:13 devstack sudo[95786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3
Nov 06 08:24:13 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:13 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3" returned: 0 in 0.816s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:24:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:13 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12
Nov 06 08:24:13 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:24 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=48,cinder:INSERT=16,cinder:UPDATE=72,cinder:DELETE=6 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:24:24 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=46,cinder:INSERT=18,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:24:25 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" returned: 0 in 11.167s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3, size 1024.00 MB, duration 11.17 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:24:25 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Converted 1024.00 MB image at 91.69 MB/s
Nov 06 08:24:25 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 is being set with open permissions: ugo+rw
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:25 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12
Nov 06 08:24:25 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:25 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" returned: 0 in 0.262s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" released by "_copy_volume_from_snapshot" :: held 13.004s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-cece0c9e-f7f4-4da9-89cf-313f866130fe" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-cece0c9e-f7f4-4da9-89cf-313f866130fe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Deleting offline snapshot cece0c9e-f7f4-4da9-89cf-313f866130fe of volume f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] snapshot_file for this snap is: volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2df25-ef61-4be7-b4d9-efaaabc8bc2c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:25 devstack sudo[95860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe
Nov 06 08:24:25 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:25 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe" returned: 0 in 0.431s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9a67e44-d17d-4091-9acf-4984943756f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b639cec-1090-49dd-93bb-8128306758fc]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:26 devstack sudo[95866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3
Nov 06 08:24:26 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:26 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3" returned: 0 in 0.606s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:26 devstack sudo[95872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe
Nov 06 08:24:26 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:26 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe" returned: 0 in 0.365s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:26 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe
Nov 06 08:24:26 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:27 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3.cece0c9e-f7f4-4da9-89cf-313f866130fe" returned: 0 in 0.360s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-cece0c9e-f7f4-4da9-89cf-313f866130fe" released by "_delete_snapshot" :: held 1.899s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.694s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a2db4f-bc06-4d25-b30a-3c37cb641a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12', 'volume_size': 1, 'source_volid': 'f9a67e44-d17d-4091-9acf-4984943756f3', 'source_volstatus': 'available'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2dbdc-a279-4bf9-b6e4-f4e49f66bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:27 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Volume volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 (d55ffa69-1a87-4b7f-ac6f-a8e4de115a12): created successfully
Nov 06 08:24:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2dbdc-a279-4bf9-b6e4-f4e49f66bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (7199c771-beae-4368-832b-3ad8a8490888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-932ffe8d-b820-4103-b1e5-28e0ff22280f tempest-VolumesGetTest-272500250 None] Created volume successfully.
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (ca10b84a-3f11-493b-a90f-9f71b7704365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8b2402-2a58-46db-a263-3af11b573c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8b2402-2a58-46db-a263-3af11b573c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2117527533',display_name='tempest-VolumesGetTest-Volume-626675143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba687492-6de0-4d5d-9231-97ab3159607d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:29Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430b2eef-92ed-428b-89c6-253a94b9f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430b2eef-92ed-428b-89c6-253a94b9f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b40ef6-4616-46d7-9736-02b2cfca95e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b40ef6-4616-46d7-9736-02b2cfca95e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba687492-6de0-4d5d-9231-97ab3159607d', 'volume_name': 'volume-ba687492-6de0-4d5d-9231-97ab3159607d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcdd042-0e4d-41a7-b292-d9dd2c087bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcdd042-0e4d-41a7-b292-d9dd2c087bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c39c09-1b98-4d03-b002-47c4dc2c4d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:29 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Volume ba687492-6de0-4d5d-9231-97ab3159607d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba687492-6de0-4d5d-9231-97ab3159607d', 'volume_size': 1}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2117527533',display_name='tempest-VolumesGetTest-Volume-626675143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba687492-6de0-4d5d-9231-97ab3159607d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:29Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Creating volume ba687492-6de0-4d5d-9231-97ab3159607d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:29 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:29 devstack sudo[95882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d 1073741824
Nov 06 08:24:29 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:29 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d 1073741824" returned: 0 in 0.550s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:30 devstack sudo[95889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d
Nov 06 08:24:30 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:30 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d" returned: 0 in 0.426s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c39c09-1b98-4d03-b002-47c4dc2c4d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba687492-6de0-4d5d-9231-97ab3159607d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:30 devstack sudo[95892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:30 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a63cfc-0955-4fd3-ab08-d8f9cd4832b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:30 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Volume volume-ba687492-6de0-4d5d-9231-97ab3159607d (ba687492-6de0-4d5d-9231-97ab3159607d): created successfully
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a63cfc-0955-4fd3-ab08-d8f9cd4832b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (ca10b84a-3f11-493b-a90f-9f71b7704365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-821314c0-d698-45a7-b0e3-1c58fd96dce9 tempest-VolumesGetTest-272500250 None] Created volume successfully.
Nov 06 08:24:30 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.424s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:24:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:24:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-ba687492-6de0-4d5d-9231-97ab3159607d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Lock "cinder-ba687492-6de0-4d5d-9231-97ab3159607d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-ba687492-6de0-4d5d-9231-97ab3159607d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-ba687492-6de0-4d5d-9231-97ab3159607d" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec28748-eb46-4c56-934f-345fe80759b8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:32 devstack sudo[95896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d
Nov 06 08:24:32 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:32 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d" returned: 0 in 0.389s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:32 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d
Nov 06 08:24:32 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:32 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ba687492-6de0-4d5d-9231-97ab3159607d" returned: 0 in 0.372s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-ba687492-6de0-4d5d-9231-97ab3159607d" released by "delete_volume" :: held 0.817s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Created reservations ['9e0a033a-f79f-4079-87b0-b77066ea0726', '1d184265-46d1-4e48-a226-b3b37cf7bc29', '1bb6644d-0eed-447b-ae32-44b0eeadf394', '0265117a-bf3b-40d7-9f54-a00a72528400'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:32 devstack sudo[95904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:32 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:33 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.315s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Lock "cinder-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Deleted volume successfully.
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebfb6f45-cc24-4850-b74f-91156b08054e tempest-VolumesGetTest-272500250 None] Lock "cinder-ba687492-6de0-4d5d-9231-97ab3159607d-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8af84db-ba4e-4ea1-8c50-ade36dc4e8ab]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:33 devstack sudo[95907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12
Nov 06 08:24:33 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:33 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" returned: 0 in 0.442s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:33 devstack sudo[95915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12
Nov 06 08:24:33 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:34 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" returned: 0 in 0.307s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12" released by "delete_volume" :: held 0.815s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Created reservations ['799f7718-b705-43cf-bc86-6c9d56d87029', '3a521d1a-63ae-41c3-8c0c-7800ae4322b0', '1b903a78-abd8-4bdc-bf68-5dd59b0443b5', 'f7d3134c-9a2f-446e-a2bf-c5fdc705e4fc'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:34 devstack sudo[95919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:34 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-f9a67e44-d17d-4091-9acf-4984943756f3-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Lock "cinder-f9a67e44-d17d-4091-9acf-4984943756f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-f9a67e44-d17d-4091-9acf-4984943756f3" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:34 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.400s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Deleted volume successfully.
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-f9a67e44-d17d-4091-9acf-4984943756f3" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27b02ec-e436-4848-a12d-180270ac5d8d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-de526270-c0e9-4fcf-a83f-7d92d3f924eb tempest-VolumesGetTest-272500250 None] Lock "cinder-d55ffa69-1a87-4b7f-ac6f-a8e4de115a12-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Flow 'volume_create_manager' (99deeb2b-7c83-40c1-8d33-3d05c2115146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3c198f-3992-4b2a-b262-095e395cd0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3c198f-3992-4b2a-b262-095e395cd0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-734621091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b086c5-1d3a-4c73-a121-3afb05755937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600e928525524d569db896c0a7cd87a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:35Z,use_quota=True,user_id='b08693066c58466ea2e7ce2e5e282f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8363f27f-32f1-4d4a-8a91-fb1eb858d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8363f27f-32f1-4d4a-8a91-fb1eb858d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c271cda-3e98-453f-a73c-12385d927668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c271cda-3e98-453f-a73c-12385d927668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b086c5-1d3a-4c73-a121-3afb05755937', 'volume_name': 'volume-19b086c5-1d3a-4c73-a121-3afb05755937', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97a6b54-70e9-4c06-9be2-979996cbb082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97a6b54-70e9-4c06-9be2-979996cbb082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a441d0b-d830-4cdb-b1f5-3eb4161d065b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Volume 19b086c5-1d3a-4c73-a121-3afb05755937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b086c5-1d3a-4c73-a121-3afb05755937', 'volume_size': 1}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-734621091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b086c5-1d3a-4c73-a121-3afb05755937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600e928525524d569db896c0a7cd87a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:35Z,use_quota=True,user_id='b08693066c58466ea2e7ce2e5e282f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Creating volume 19b086c5-1d3a-4c73-a121-3afb05755937 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:34 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:34 devstack sudo[95922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3
Nov 06 08:24:34 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:34 devstack sudo[95923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937 1073741824
Nov 06 08:24:34 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:35 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3" returned: 0 in 0.436s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:35 devstack sudo[95932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3
Nov 06 08:24:35 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:35 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937 1073741824" returned: 0 in 0.599s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:35 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f9a67e44-d17d-4091-9acf-4984943756f3" returned: 0 in 0.356s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-f9a67e44-d17d-4091-9acf-4984943756f3" released by "delete_volume" :: held 0.900s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:35 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937
Nov 06 08:24:35 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Created reservations ['322cd866-154d-41bf-84b7-dcda1cd97cb3', '24d8a3dc-83a1-47bc-bc08-4cf727257754', 'f0fd4056-1797-468f-b8cb-cc2329440367', 'f120912d-501e-42d3-96ea-fbc0c4f1408a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:35 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:35 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:35 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937" returned: 0 in 0.421s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a441d0b-d830-4cdb-b1f5-3eb4161d065b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b086c5-1d3a-4c73-a121-3afb05755937', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da64160-07f2-4eba-b659-3dd15900c9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:36 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Volume volume-19b086c5-1d3a-4c73-a121-3afb05755937 (19b086c5-1d3a-4c73-a121-3afb05755937): created successfully
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da64160-07f2-4eba-b659-3dd15900c9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Flow 'volume_create_manager' (99deeb2b-7c83-40c1-8d33-3d05c2115146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-53f1970c-f7b9-4322-8e7c-849d1d51444f tempest-AttachVolumeShelveTestJSON-101959322 None] Created volume successfully.
Nov 06 08:24:36 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.407s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Deleted volume successfully.
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c9f99919-0901-4a34-9db7-c1f607237d4f tempest-VolumesGetTest-272500250 None] Lock "cinder-f9a67e44-d17d-4091-9acf-4984943756f3-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (bf19391a-b24d-4bb3-9c06-6acaa85a7170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed6fe74-dd91-4906-9047-c3bf6725b34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed6fe74-dd91-4906-9047-c3bf6725b34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1331216873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed7552e-a927-44d3-8bde-39b766288324,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:37Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc593c7-4271-4f8a-aed6-472fdb3313b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc593c7-4271-4f8a-aed6-472fdb3313b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e707ba7-ede2-4a20-8fcf-f88e5f762737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:36 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:24:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e707ba7-ede2-4a20-8fcf-f88e5f762737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ed7552e-a927-44d3-8bde-39b766288324', 'volume_name': 'volume-0ed7552e-a927-44d3-8bde-39b766288324', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107497770>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce9bffa-b2f5-4999-8975-419639e4ebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce9bffa-b2f5-4999-8975-419639e4ebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a328d2-0677-435c-b22a-97be5b33b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Volume 0ed7552e-a927-44d3-8bde-39b766288324: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ed7552e-a927-44d3-8bde-39b766288324', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107497770>}
Nov 06 08:24:37 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Trying to clone 0ed7552e-a927-44d3-8bde-39b766288324 from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:24:38 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:24:38 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 08:24:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad02847-1c9d-40b0-b5b8-cc34dd59284d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:38 devstack sudo[95950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD
Nov 06 08:24:38 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:38 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:38 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a is fetched for user 10618e9429e7483b98e517898b6b44eb. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:24:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a21c5f-c65e-47e4-aa5b-ffd2ef5b6c36]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:38 devstack sudo[95957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD
Nov 06 08:24:38 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:39 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1331216873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed7552e-a927-44d3-8bde-39b766288324,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:37Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Creating volume 0ed7552e-a927-44d3-8bde-39b766288324 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:39 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:39 devstack sudo[95968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 1073741824
Nov 06 08:24:39 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:39 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (ec34a4f7-08bb-4e28-884b-7380c69c9891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97829d2b-4ed7-4d20-83e8-0d84783971ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 1073741824" returned: 0 in 0.642s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97829d2b-4ed7-4d20-83e8-0d84783971ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1053462137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5c5332-f649-42d2-aeb0-60bd1ca23768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:40Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d407fbdf-afb7-4023-81d6-46fa1d9ba7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d407fbdf-afb7-4023-81d6-46fa1d9ba7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46f420-44b1-4e77-9998-b5985f7ed724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46f420-44b1-4e77-9998-b5985f7ed724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5c5332-f649-42d2-aeb0-60bd1ca23768', 'volume_name': 'volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512b8c3e-8e4b-43ca-9c17-0e104a2803a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512b8c3e-8e4b-43ca-9c17-0e104a2803a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a28dcb-4a70-4354-a419-219aa2dad978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:39 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Volume cd5c5332-f649-42d2-aeb0-60bd1ca23768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768', 'volume_size': 1}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:39 devstack sudo[95981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324
Nov 06 08:24:39 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:40 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324" returned: 0 in 0.317s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1053462137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5c5332-f649-42d2-aeb0-60bd1ca23768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:40Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Creating volume cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:40 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:40 devstack sudo[95984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 1073741824
Nov 06 08:24:40 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Attempting download of b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume 0ed7552e-a927-44d3-8bde-39b766288324. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[155c2a9f-a7c8-4562-97f2-d3da1a8eee27]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_yllkr03i {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:40 devstack sudo[95986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_yllkr03i
Nov 06 08:24:40 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:40 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_yllkr03i" returned: 0 in 0.488s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_yllkr03i {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:40 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 1073741824" returned: 0 in 0.676s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:40 devstack sudo[95996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768
Nov 06 08:24:40 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:40 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_yllkr03i
Nov 06 08:24:40 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:41 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768" returned: 0 in 0.302s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:41 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_yllkr03i" returned: 1 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_yllkr03i' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d52309b-11bc-4358-ba65-9d8e541da308]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a28dcb-4a70-4354-a419-219aa2dad978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8ba763-9a2f-40d5-93bb-eda3f6dd507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:41 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Volume volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 (cd5c5332-f649-42d2-aeb0-60bd1ca23768): created successfully
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8ba763-9a2f-40d5-93bb-eda3f6dd507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (ec34a4f7-08bb-4e28-884b-7380c69c9891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a1e9af46-b8d0-4bb6-a95d-95162d8d6abe tempest-VolumesSnapshotTestJSON-437827459 None] Created volume successfully.
Nov 06 08:24:41 devstack sudo[96002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD
Nov 06 08:24:41 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:41 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] b5f6cea8-26cc-40f2-998e-90a6fcdc116a was qcow2, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:24:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:41 devstack sudo[96008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324
Nov 06 08:24:41 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Creating offline snapshot 5ccc1ac2-8401-403e-b7b2-4a22488eb388 of volume cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:24:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e1640c-9b1e-4fce-be95-0bcbeefa10ed]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:42 devstack sudo[96015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768
Nov 06 08:24:42 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:42 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768" returned: 0 in 0.623s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:43 devstack sudo[96020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 1G
Nov 06 08:24:43 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:43 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 1G" returned: 0 in 0.594s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:43 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388
Nov 06 08:24:43 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:44 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388" returned: 0 in 0.515s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:44 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 is being set with open permissions: ugo+rw
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:44 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388
Nov 06 08:24:44 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:44 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324" returned: 0 in 2.713s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_19zcye7odevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:24:44 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Converted 112.00 MB image at 41.23 MB/s
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:44 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 1G
Nov 06 08:24:44 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:44 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388" returned: 0 in 0.442s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:44 devstack sudo[96038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.info
Nov 06 08:24:44 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:44 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 1G" returned: 0 in 0.465s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Downloaded image b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume 0ed7552e-a927-44d3-8bde-39b766288324 successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a for user 10618e9429e7483b98e517898b6b44eb is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Marking volume 0ed7552e-a927-44d3-8bde-39b766288324 as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Copying metadata from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a to 0ed7552e-a927-44d3-8bde-39b766288324. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Creating volume glance metadata for volume 0ed7552e-a927-44d3-8bde-39b766288324 backed by image b5f6cea8-26cc-40f2-998e-90a6fcdc116a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:24:44 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.info" returned: 0 in 0.364s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:44 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.info is being set with open permissions: ugo+rw
Nov 06 08:24:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:44 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.info
Nov 06 08:24:44 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a328d2-0677-435c-b22a-97be5b33b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed7552e-a927-44d3-8bde-39b766288324', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107497770>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68342604-25d0-4733-b77c-c0e3c9fdb140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Volume volume-0ed7552e-a927-44d3-8bde-39b766288324 (0ed7552e-a927-44d3-8bde-39b766288324): created successfully
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68342604-25d0-4733-b77c-c0e3c9fdb140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (bf19391a-b24d-4bb3-9c06-6acaa85a7170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a8f0e4d2-beb6-4e2b-be50-5d24d9869feb tempest-VolumesGetTest-272500250 None] Created volume successfully.
Nov 06 08:24:45 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.info" returned: 0 in 0.349s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d373558c-f4d3-4dba-9a22-0b484e050d14 tempest-VolumesSnapshotTestJSON-437827459 None] Create snapshot completed successfully
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-5ccc1ac2-8401-403e-b7b2-4a22488eb388-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-5ccc1ac2-8401-403e-b7b2-4a22488eb388-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-cd5c5332-f649-42d2-aeb0-60bd1ca23768" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-cd5c5332-f649-42d2-aeb0-60bd1ca23768" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-5ccc1ac2-8401-403e-b7b2-4a22488eb388" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-5ccc1ac2-8401-403e-b7b2-4a22488eb388" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Deleting offline snapshot 5ccc1ac2-8401-403e-b7b2-4a22488eb388 of volume cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] snapshot_file for this snap is: volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61cd65-179e-4015-9b97-d9f3bce1575e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:46 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388
Nov 06 08:24:46 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:46 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (117e8428-dfaf-46b5-bdac-e729b34f77b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45cf27d-78c3-4f9e-acc9-8186a90c33dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388" returned: 0 in 0.636s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45cf27d-78c3-4f9e-acc9-8186a90c33dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1283122840',display_name='tempest-VolumesGetTest-Volume-314129431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b017e5fb-787b-45f2-b249-8c330e34ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:46Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3747a71-b508-4054-927d-81435f839f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3747a71-b508-4054-927d-81435f839f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2715418c-c124-49d4-9b07-fb55291b3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2715418c-c124-49d4-9b07-fb55291b3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b017e5fb-787b-45f2-b249-8c330e34ad09', 'volume_name': 'volume-b017e5fb-787b-45f2-b249-8c330e34ad09', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f7089b-ba4d-4dad-a3d2-46b75ad7d505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f7089b-ba4d-4dad-a3d2-46b75ad7d505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055d8aac-5c6d-4f11-902a-7975a5268a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Volume b017e5fb-787b-45f2-b249-8c330e34ad09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b017e5fb-787b-45f2-b249-8c330e34ad09', 'volume_size': 1}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1283122840',display_name='tempest-VolumesGetTest-Volume-314129431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b017e5fb-787b-45f2-b249-8c330e34ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375aa51b5d6f469a93188dc58e216a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:46Z,use_quota=True,user_id='10618e9429e7483b98e517898b6b44eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Creating volume b017e5fb-787b-45f2-b249-8c330e34ad09 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:46 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921be40-5f6d-4b3e-94ae-d72efbccf1b4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:46 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09 1073741824
Nov 06 08:24:46 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:46 devstack sudo[96054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768
Nov 06 08:24:46 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:47 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768" returned: 0 in 0.488s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:47 devstack sudo[96065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388
Nov 06 08:24:47 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:47 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09 1073741824" returned: 0 in 0.784s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:47 devstack sudo[96087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09
Nov 06 08:24:47 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:47 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388" returned: 0 in 0.665s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:47 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388
Nov 06 08:24:47 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:48 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09" returned: 0 in 0.368s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055d8aac-5c6d-4f11-902a-7975a5268a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b017e5fb-787b-45f2-b249-8c330e34ad09', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436bef56-b102-4295-acf8-60cf2db47b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Volume volume-b017e5fb-787b-45f2-b249-8c330e34ad09 (b017e5fb-787b-45f2-b249-8c330e34ad09): created successfully
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436bef56-b102-4295-acf8-60cf2db47b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Flow 'volume_create_manager' (117e8428-dfaf-46b5-bdac-e729b34f77b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ecf6fdb2-9308-4c12-9cc7-2937bf211f36 tempest-VolumesGetTest-272500250 None] Created volume successfully.
Nov 06 08:24:48 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768.5ccc1ac2-8401-403e-b7b2-4a22488eb388" returned: 0 in 0.372s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-5ccc1ac2-8401-403e-b7b2-4a22488eb388" released by "_delete_snapshot" :: held 2.421s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-cd5c5332-f649-42d2-aeb0-60bd1ca23768" released by "delete_snapshot" :: held 2.456s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['9707589f-f753-4436-9bab-bbdd659b4c8c', '8cea2419-1e16-46e8-aac5-6d01e32a0464', 'ac259403-d284-4026-9237-fe5ebc875965', 'd2830dbf-4ab4-466c-825f-14f02279d55e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Delete snapshot completed successfully.
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e146492f-c24d-4919-a224-7eb126ffda0d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-5ccc1ac2-8401-403e-b7b2-4a22488eb388-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-b017e5fb-787b-45f2-b249-8c330e34ad09-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Lock "cinder-b017e5fb-787b-45f2-b249-8c330e34ad09-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-b017e5fb-787b-45f2-b249-8c330e34ad09" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-b017e5fb-787b-45f2-b249-8c330e34ad09" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3d72c-ba2b-4eb1-a804-0bbbce853fa2]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:49 devstack sudo[96096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09
Nov 06 08:24:49 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:49 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09" returned: 0 in 0.629s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:49 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09
Nov 06 08:24:49 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:50 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b017e5fb-787b-45f2-b249-8c330e34ad09" returned: 0 in 0.430s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-b017e5fb-787b-45f2-b249-8c330e34ad09" released by "delete_volume" :: held 1.136s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (11cd48ca-31b7-4651-a3bb-2ad8ec43e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605d4fc6-e6ec-4ca7-9d3b-59df2d16a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605d4fc6-e6ec-4ca7-9d3b-59df2d16a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607740376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d0de37-ebb2-4772-b15d-e41e26f8e8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:50Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12be5146-e8c1-4e0a-8c97-34e5af0ac6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12be5146-e8c1-4e0a-8c97-34e5af0ac6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7567c5bf-1a96-4423-9efa-7e35765fef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7567c5bf-1a96-4423-9efa-7e35765fef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d0de37-ebb2-4772-b15d-e41e26f8e8d1', 'volume_name': 'volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e70019-c59b-4c60-976d-210ba92e5e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e70019-c59b-4c60-976d-210ba92e5e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae49aee-836a-4262-87e1-0546650b058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:50 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Volume a5d0de37-ebb2-4772-b15d-e41e26f8e8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1', 'volume_size': 1}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607740376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d0de37-ebb2-4772-b15d-e41e26f8e8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:50Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Creating volume a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:50 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:50 devstack sudo[96106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 1073741824
Nov 06 08:24:50 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Created reservations ['7eb360de-4104-451b-9f3e-45f8e5a8cb04', '34d926c9-ce67-4f0d-98f0-d3a99e129794', '84887356-493e-4e0d-97b0-a62776ae4f76', 'b5f805f9-b06e-4579-95e9-b7e29b517112'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:50 devstack sudo[96108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:50 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-b0064ea4-a733-4efd-9c86-49d53475de3a req-fd8f5a25-52a7-4d8f-864c-d0fdbb841244 tempest-AttachVolumeShelveTestJSON-101959322 None] No connector for attachment da0f080d-f257-4f82-9f37-57bb4d03909e; skipping storage backend terminate_connection call. {{(pid=87143) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-b0064ea4-a733-4efd-9c86-49d53475de3a req-fd8f5a25-52a7-4d8f-864c-d0fdbb841244 tempest-AttachVolumeShelveTestJSON-101959322 None] Deleting attachment da0f080d-f257-4f82-9f37-57bb4d03909e. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:24:50 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.444s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Deleted volume successfully.
Nov 06 08:24:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ca59a6b-068b-4458-a496-22c2213a3324 tempest-VolumesGetTest-272500250 None] Lock "cinder-b017e5fb-787b-45f2-b249-8c330e34ad09-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:51 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 1073741824" returned: 0 in 0.763s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:51 devstack sudo[96115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1
Nov 06 08:24:51 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-0ed7552e-a927-44d3-8bde-39b766288324-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Lock "cinder-0ed7552e-a927-44d3-8bde-39b766288324-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Acquiring lock "cinder-quobyte-0ed7552e-a927-44d3-8bde-39b766288324" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-0ed7552e-a927-44d3-8bde-39b766288324" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ae3ab-0383-487b-9e72-3ed2bd34f847]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:51 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" returned: 0 in 0.437s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae49aee-836a-4262-87e1-0546650b058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848bc045-74d6-4d4c-9d64-ae7cefa9a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:51 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Volume volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 (a5d0de37-ebb2-4772-b15d-e41e26f8e8d1): created successfully
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848bc045-74d6-4d4c-9d64-ae7cefa9a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:51 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324
Nov 06 08:24:51 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (11cd48ca-31b7-4651-a3bb-2ad8ec43e785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:51 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-56c5be98-c69d-41c2-9467-81aa0d1c078c tempest-VolumesSnapshotTestJSON-437827459 None] Created volume successfully.
Nov 06 08:24:51 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324" returned: 0 in 0.470s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:51 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324
Nov 06 08:24:51 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Creating offline snapshot 55d0fa16-3d10-41ed-b8c4-95a38836ace8 of volume a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:24:52 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0ed7552e-a927-44d3-8bde-39b766288324" returned: 0 in 0.405s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0831f608-703a-4398-99b4-c9376aed5a1f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Lock "cinder-quobyte-0ed7552e-a927-44d3-8bde-39b766288324" released by "delete_volume" :: held 0.966s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Created reservations ['337002d4-c02f-4d4b-9291-ba447634f478', '8ddfcf30-0b74-4e10-a1c9-e2246d3edbac', 'ee03eff3-5518-4b62-8773-aab466bb908a', '13aca919-d493-44a5-9f03-7ae1d3837f67'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:24:52 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1
Nov 06 08:24:52 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:52 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:24:52 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:52 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" returned: 0 in 0.588s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:52 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 1G
Nov 06 08:24:52 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:53 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.403s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:53 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:24:53 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Deleted volume successfully.
Nov 06 08:24:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f862a7af-ea3a-4e2d-a871-a2329c79e3c0 tempest-VolumesGetTest-272500250 None] Lock "cinder-0ed7552e-a927-44d3-8bde-39b766288324-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:24:53 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 1G" returned: 0 in 0.513s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:53 devstack sudo[96144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8
Nov 06 08:24:53 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:53 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8" returned: 0 in 0.488s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:53 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 is being set with open permissions: ugo+rw
Nov 06 08:24:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:53 devstack sudo[96149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8
Nov 06 08:24:53 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:54 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8" returned: 0 in 0.318s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:54 devstack sudo[96152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.info
Nov 06 08:24:54 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:54 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.info" returned: 0 in 0.331s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:54 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.info is being set with open permissions: ugo+rw
Nov 06 08:24:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:54 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.info
Nov 06 08:24:54 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:54 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.info" returned: 0 in 0.292s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c9a2a943-b736-42d6-a414-f229670ab550 tempest-VolumesSnapshotTestJSON-437827459 None] Create snapshot completed successfully
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (b47998e4-30bc-4ebc-8643-a52b1e226121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407fa601-3600-4271-9bcc-263291f49e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407fa601-3600-4271-9bcc-263291f49e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1308508892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bd0268-ca25-4c8e-a675-4ff6fe5534d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:24:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=55d0fa16-3d10-41ed-b8c4-95a38836ace8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:24:56Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6617f8d3-b61a-4e21-8b1d-cb27d9f4c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6617f8d3-b61a-4e21-8b1d-cb27d9f4c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eddbdb4f-e8f4-48e5-915c-85e1b35b3330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eddbdb4f-e8f4-48e5-915c-85e1b35b3330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8bd0268-ca25-4c8e-a675-4ff6fe5534d0', 'volume_name': 'volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0', 'volume_size': 2, 'snapshot_id': '55d0fa16-3d10-41ed-b8c4-95a38836ace8'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f27e9e-230d-4c4f-aecd-646dee8fa168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f27e9e-230d-4c4f-aecd-646dee8fa168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1871483-e806-49ae-838c-6767e4e2f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:24:56 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Volume b8bd0268-ca25-4c8e-a675-4ff6fe5534d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0', 'volume_size': 2, 'snapshot_id': '55d0fa16-3d10-41ed-b8c4-95a38836ace8'}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-55d0fa16-3d10-41ed-b8c4-95a38836ace8-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-55d0fa16-3d10-41ed-b8c4-95a38836ace8-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Creating volume b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 from snapshot 55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] snapshot: 55d0fa16-3d10-41ed-b8c4-95a38836ace8, volume: b8bd0268-ca25-4c8e-a675-4ff6fe5534d0,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[00387fef-d2ec-488c-9bb4-c9c3f9e3064a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:56 devstack sudo[96160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8
Nov 06 08:24:56 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:56 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8" returned: 0 in 0.593s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:24:57 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1100a7e-bbb6-4da1-9adc-db6bfea2d7e3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:24:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:57 devstack sudo[96165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1
Nov 06 08:24:57 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:24:57 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root
Nov 06 08:24:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" returned: 0 in 0.640s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:24:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:24:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:24:57 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:24:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:24:57 devstack sudo[96170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0
Nov 06 08:24:57 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:06 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=65,cinder:SELECT=68,cinder:DELETE=8,cinder:INSERT=24 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:25:06 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=80,cinder:SELECT=66,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:25:09 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" returned: 0 in 11.542s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:09 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1, size 1024.00 MB, duration 11.55 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:25:09 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Converted 1024.00 MB image at 88.69 MB/s
Nov 06 08:25:09 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 is being set with open permissions: ugo+rw
Nov 06 08:25:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:09 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0
Nov 06 08:25:09 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:09 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" returned: 0 in 0.644s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:09 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" released by "_copy_volume_from_snapshot" :: held 13.571s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:09 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-55d0fa16-3d10-41ed-b8c4-95a38836ace8-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" released by "_create_volume_from_snapshot" :: held 13.696s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.718s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1871483-e806-49ae-838c-6767e4e2f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0', 'volume_size': 2, 'snapshot_id': '55d0fa16-3d10-41ed-b8c4-95a38836ace8'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e77e9dd-5da5-4a54-a515-d92cbbf97296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:10 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Volume volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 (b8bd0268-ca25-4c8e-a675-4ff6fe5534d0): created successfully
Nov 06 08:25:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e77e9dd-5da5-4a54-a515-d92cbbf97296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (b47998e4-30bc-4ebc-8643-a52b1e226121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1c7c9c40-cd34-4507-9368-5762387b5cbd tempest-VolumesSnapshotTestJSON-437827459 None] Created volume successfully.
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29a241b-5c46-45e0-80e9-b46592c66c73]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:11 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0
Nov 06 08:25:11 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:11 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" returned: 0 in 0.578s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:11 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0
Nov 06 08:25:11 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:12 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" returned: 0 in 0.349s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0" released by "delete_volume" :: held 1.071s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['808c199c-2762-456d-b15e-b321f0d43daf', 'ac904d3b-5415-4133-af95-510ceca7dce2', 'd0865421-9644-4140-8690-1f2b47d55149', '84fcf068-bcd6-4b7e-8a47-95115079c97d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:12 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:12 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:12 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.311s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Deleted volume successfully.
Nov 06 08:25:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a2b63aa4-e547-45de-b72d-42951055ff4a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-b8bd0268-ca25-4c8e-a675-4ff6fe5534d0-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-55d0fa16-3d10-41ed-b8c4-95a38836ace8-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-55d0fa16-3d10-41ed-b8c4-95a38836ace8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-55d0fa16-3d10-41ed-b8c4-95a38836ace8" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-55d0fa16-3d10-41ed-b8c4-95a38836ace8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Deleting offline snapshot 55d0fa16-3d10-41ed-b8c4-95a38836ace8 of volume a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] snapshot_file for this snap is: volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c95590-3d53-4495-8e84-91c9fb80e9bc]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:13 devstack sudo[96681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8
Nov 06 08:25:13 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:14 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8" returned: 0 in 0.604s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:25:14 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e2adb-a2e2-47f1-9887-77b1e0752dc1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:14 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1
Nov 06 08:25:14 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:15 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" returned: 0 in 1.156s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:15 devstack sudo[96781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8
Nov 06 08:25:15 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:16 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8" returned: 0 in 0.717s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:16 devstack sudo[96787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8
Nov 06 08:25:16 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:16 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1.55d0fa16-3d10-41ed-b8c4-95a38836ace8" returned: 0 in 0.463s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-55d0fa16-3d10-41ed-b8c4-95a38836ace8" released by "_delete_snapshot" :: held 3.168s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" released by "delete_snapshot" :: held 3.208s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:16 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['8b608caa-9e96-47d5-941c-3725e773aa48', '45621657-e00f-4108-91ca-9ae109036a0f', 'e1780e82-9603-4f49-ac61-b170f9f817ab', '27d752ad-9793-4115-af09-9c996600aadb'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Delete snapshot completed successfully.
Nov 06 08:25:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8b8a38bf-4757-4915-8780-15edbee70e37 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-55d0fa16-3d10-41ed-b8c4-95a38836ace8-delete_snapshot" released by "delete_snapshot" :: held 3.478s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec53e9-5490-4eb8-af4c-1a534c0ba920]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:18 devstack sudo[96808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1
Nov 06 08:25:18 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:19 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" returned: 0 in 0.714s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:19 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1
Nov 06 08:25:19 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:19 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" returned: 0 in 0.574s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1" released by "delete_volume" :: held 1.457s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:19 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['bf2758e3-0beb-4fff-a88b-6c2f374adbdd', '71cf7cab-363d-4d06-85f5-e8b61f1eca35', '0e882e30-dd57-40de-8953-6538ccd4aadd', '85c0c898-77f0-4609-a406-12a140412044'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:20 devstack sudo[96826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:20 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:20 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.428s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Deleted volume successfully.
Nov 06 08:25:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1dd1ed32-a817-4f3e-b70c-061c0e61c06a tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-a5d0de37-ebb2-4772-b15d-e41e26f8e8d1-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (3e782503-2849-4d44-a7d1-04f6a01e0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40b8f0a-cd1b-4c1e-a115-66dddffb1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40b8f0a-cd1b-4c1e-a115-66dddffb1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-368846470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925b71b6-6c50-453a-8601-9e81931394bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:22Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc74887a-a185-42f8-8b21-d8dd72d37144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc74887a-a185-42f8-8b21-d8dd72d37144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3084e1c7-eb80-4897-ae9a-0b1573003abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3084e1c7-eb80-4897-ae9a-0b1573003abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925b71b6-6c50-453a-8601-9e81931394bd', 'volume_name': 'volume-925b71b6-6c50-453a-8601-9e81931394bd', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67b3d8e-46f8-4bf4-81ae-833b42044d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67b3d8e-46f8-4bf4-81ae-833b42044d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba49215-ad70-4b69-ae4c-40eaa35182b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:21 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Volume 925b71b6-6c50-453a-8601-9e81931394bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925b71b6-6c50-453a-8601-9e81931394bd', 'volume_size': 1}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-368846470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925b71b6-6c50-453a-8601-9e81931394bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:22Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Creating volume 925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:25:21 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:25:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:21 devstack sudo[96833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd 1073741824
Nov 06 08:25:21 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:22 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd 1073741824" returned: 0 in 0.695s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:22 devstack sudo[96840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd
Nov 06 08:25:22 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:22 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd" returned: 0 in 0.328s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba49215-ad70-4b69-ae4c-40eaa35182b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925b71b6-6c50-453a-8601-9e81931394bd', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3453f58a-b3bb-4c9c-90a9-dcb604cd5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:22 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Volume volume-925b71b6-6c50-453a-8601-9e81931394bd (925b71b6-6c50-453a-8601-9e81931394bd): created successfully
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3453f58a-b3bb-4c9c-90a9-dcb604cd5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (3e782503-2849-4d44-a7d1-04f6a01e0f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b580b65d-caa6-4b05-99dd-f977a90e3659 tempest-VolumesSnapshotTestJSON-437827459 None] Created volume successfully.
Nov 06 08:25:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Creating offline snapshot 1c7dd23b-52d7-4196-9731-0ee2a03d6275 of volume 925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:25:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e30710-b77a-4473-ad47-069fc496b231]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:24 devstack sudo[96895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd
Nov 06 08:25:24 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:24 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd" returned: 0 in 0.647s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:24 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 1G
Nov 06 08:25:24 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:25 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 1G" returned: 0 in 0.676s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925b71b6-6c50-453a-8601-9e81931394bd -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:25 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925b71b6-6c50-453a-8601-9e81931394bd -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275
Nov 06 08:25:25 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:25 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925b71b6-6c50-453a-8601-9e81931394bd -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275" returned: 0 in 0.468s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:25 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 is being set with open permissions: ugo+rw
Nov 06 08:25:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:25 devstack sudo[96929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275
Nov 06 08:25:25 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:26 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275" returned: 0 in 0.312s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:26 devstack sudo[96932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.info
Nov 06 08:25:26 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:26 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.info" returned: 0 in 0.381s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:26 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.info is being set with open permissions: ugo+rw
Nov 06 08:25:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:26 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.info
Nov 06 08:25:26 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:26 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.info" returned: 0 in 0.295s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.999s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-222e6de8-cf18-4c56-93e1-144a291a4d7f tempest-VolumesSnapshotTestJSON-437827459 None] Create snapshot completed successfully
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (6a59fc30-5ad2-4377-90b7-406e4f4e5a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0267a6-33b5-4b3c-a97b-60898282674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0267a6-33b5-4b3c-a97b-60898282674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-204456781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a7cd9f-236b-4212-90e2-10f206325fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4154913f7e4f889d41ae1710289105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c7dd23b-52d7-4196-9731-0ee2a03d6275,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:28Z,use_quota=True,user_id='385215a1520848c58f5622948f7e12b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac83ab97-7741-4422-8b15-ada04e131049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac83ab97-7741-4422-8b15-ada04e131049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3166bced-8224-4817-a714-10a2700ded0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3166bced-8224-4817-a714-10a2700ded0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69a7cd9f-236b-4212-90e2-10f206325fc4', 'volume_name': 'volume-69a7cd9f-236b-4212-90e2-10f206325fc4', 'volume_size': 1, 'snapshot_id': '1c7dd23b-52d7-4196-9731-0ee2a03d6275'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2170eb6-d437-4586-a81d-c4b5d86b2dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2170eb6-d437-4586-a81d-c4b5d86b2dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dac8a2-6412-4d50-8d15-6e9fa0f02b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:28 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Volume 69a7cd9f-236b-4212-90e2-10f206325fc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69a7cd9f-236b-4212-90e2-10f206325fc4', 'volume_size': 1, 'snapshot_id': '1c7dd23b-52d7-4196-9731-0ee2a03d6275'}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-1c7dd23b-52d7-4196-9731-0ee2a03d6275-69a7cd9f-236b-4212-90e2-10f206325fc4" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-1c7dd23b-52d7-4196-9731-0ee2a03d6275-69a7cd9f-236b-4212-90e2-10f206325fc4" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Creating volume 69a7cd9f-236b-4212-90e2-10f206325fc4 from snapshot 1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-69a7cd9f-236b-4212-90e2-10f206325fc4" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-69a7cd9f-236b-4212-90e2-10f206325fc4" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] snapshot: 1c7dd23b-52d7-4196-9731-0ee2a03d6275, volume: 69a7cd9f-236b-4212-90e2-10f206325fc4,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6789780-ef85-40ee-b5db-b726227c58c3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:28 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275
Nov 06 08:25:28 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:29 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275" returned: 0 in 0.628s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-925b71b6-6c50-453a-8601-9e81931394bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:25:29 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d187184c-d2c3-425c-b0e3-6abfe61c2c10]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:29 devstack sudo[96946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd
Nov 06 08:25:29 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:30 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd" returned: 0 in 0.796s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:30 devstack sudo[96951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4
Nov 06 08:25:30 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:30 devstack sudo[96957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:30 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:30 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.458s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:25:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:25:38 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=2,cinder:UPDATE=29 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:25:38 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=29,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:25:40 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4" returned: 0 in 10.531s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd, size 1024.00 MB, duration 10.53 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:25:40 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Converted 1024.00 MB image at 97.22 MB/s
Nov 06 08:25:40 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4 is being set with open permissions: ugo+rw
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:40 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4
Nov 06 08:25:40 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:40 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-69a7cd9f-236b-4212-90e2-10f206325fc4" released by "_copy_volume_from_snapshot" :: held 12.365s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-1c7dd23b-52d7-4196-9731-0ee2a03d6275-69a7cd9f-236b-4212-90e2-10f206325fc4" released by "_create_volume_from_snapshot" :: held 12.473s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.520s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dac8a2-6412-4d50-8d15-6e9fa0f02b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a7cd9f-236b-4212-90e2-10f206325fc4', 'volume_size': 1, 'snapshot_id': '1c7dd23b-52d7-4196-9731-0ee2a03d6275'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f89556-f610-45a4-90c1-10b6a0047ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:41 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Volume volume-69a7cd9f-236b-4212-90e2-10f206325fc4 (69a7cd9f-236b-4212-90e2-10f206325fc4): created successfully
Nov 06 08:25:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f89556-f610-45a4-90c1-10b6a0047ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Flow 'volume_create_manager' (6a59fc30-5ad2-4377-90b7-406e4f4e5a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a5f2aa86-f058-41d0-a489-4508c7466bde tempest-VolumesSnapshotTestJSON-437827459 None] Created volume successfully.
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-69a7cd9f-236b-4212-90e2-10f206325fc4-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-69a7cd9f-236b-4212-90e2-10f206325fc4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-69a7cd9f-236b-4212-90e2-10f206325fc4" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-69a7cd9f-236b-4212-90e2-10f206325fc4" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7139dc-8faa-4df9-9c4e-1d3d839f81e9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:42 devstack sudo[97015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4
Nov 06 08:25:42 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Acquiring lock "cinder-19b086c5-1d3a-4c73-a121-3afb05755937-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "cinder-19b086c5-1d3a-4c73-a121-3afb05755937-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Acquiring lock "cinder-quobyte-19b086c5-1d3a-4c73-a121-3afb05755937" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "cinder-quobyte-19b086c5-1d3a-4c73-a121-3afb05755937" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f479e4-89b7-4848-9d2d-508152fc75a6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:42 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4" returned: 0 in 0.455s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:42 devstack sudo[97021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4
Nov 06 08:25:42 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:42 devstack sudo[97020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937
Nov 06 08:25:42 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:42 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-69a7cd9f-236b-4212-90e2-10f206325fc4" returned: 0 in 0.297s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-69a7cd9f-236b-4212-90e2-10f206325fc4" released by "delete_volume" :: held 0.810s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['f58317b9-719d-48e1-b2cc-a6736ddb3759', '9bf3cd8e-208c-4289-963b-02774d9edd65', '41f529a2-cb60-43b7-af4f-af6b78276963', '1a993c7c-d39a-4a3a-a9e8-893938177a0a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:43 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:43 devstack sudo[97028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937
Nov 06 08:25:43 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:43 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:43 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-1c7dd23b-52d7-4196-9731-0ee2a03d6275-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:43 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-1c7dd23b-52d7-4196-9731-0ee2a03d6275-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-925b71b6-6c50-453a-8601-9e81931394bd" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-19b086c5-1d3a-4c73-a121-3afb05755937" returned: 0 in 0.327s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-925b71b6-6c50-453a-8601-9e81931394bd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-1c7dd23b-52d7-4196-9731-0ee2a03d6275" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "cinder-quobyte-19b086c5-1d3a-4c73-a121-3afb05755937" released by "delete_volume" :: held 0.794s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-1c7dd23b-52d7-4196-9731-0ee2a03d6275" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Deleting offline snapshot 1c7dd23b-52d7-4196-9731-0ee2a03d6275 of volume 925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] snapshot_file for this snap is: volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:25:43 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.307s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f86b650-b730-4bf7-af2f-f8fb89cb91e2]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:43 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Deleted volume successfully.
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adbbdcff-5d65-4dd5-9c54-b565cce78c22 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-69a7cd9f-236b-4212-90e2-10f206325fc4-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Created reservations ['78720e0b-3bcb-4dcd-8671-0c4917552163', '46c9b4f2-4ea9-469d-ae35-7ccd4acb4698', 'cc8d0b2d-0d06-497f-9709-759d73bce7e1', '5cea94cd-6d48-46f0-bc7b-278a929c1d56'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:43 devstack sudo[97034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275
Nov 06 08:25:43 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:43 devstack sudo[97036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:43 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:43 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275" returned: 0 in 0.448s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-925b71b6-6c50-453a-8601-9e81931394bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:25:43 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d9eb03-f961-453d-be3f-a9c335c94dfa]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.360s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:43 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:43 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Deleted volume successfully.
Nov 06 08:25:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d24644b3-6c25-4455-8724-e63488bd9d4f tempest-AttachVolumeShelveTestJSON-101959322 None] Lock "cinder-19b086c5-1d3a-4c73-a121-3afb05755937-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:44 devstack sudo[97042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd
Nov 06 08:25:44 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:44 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd" returned: 0 in 0.708s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:44 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275
Nov 06 08:25:44 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:45 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275" returned: 0 in 0.474s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:45 devstack sudo[97053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275
Nov 06 08:25:45 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:45 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd.1c7dd23b-52d7-4196-9731-0ee2a03d6275" returned: 0 in 0.279s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-1c7dd23b-52d7-4196-9731-0ee2a03d6275" released by "_delete_snapshot" :: held 2.085s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-925b71b6-6c50-453a-8601-9e81931394bd" released by "delete_snapshot" :: held 2.115s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['26550304-a898-426f-bd1c-f94959d9f61c', '8a9ca421-18e5-4471-9571-bc5ddd864ff1', '5d8eff27-d511-4dba-86d1-008cc75047f6', '992d7945-65aa-4f91-aa73-cc8644fbec86'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Delete snapshot completed successfully.
Nov 06 08:25:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-802dd7f3-f422-48fd-9d66-4fdc5c6ce123 tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-1c7dd23b-52d7-4196-9731-0ee2a03d6275-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Flow 'volume_create_manager' (59f41c95-3177-447c-a058-22e9f24969cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf5b221-3d7b-4bcc-9608-e87577f9411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf5b221-3d7b-4bcc-9608-e87577f9411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-878948335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc134cef9c78485b93c820917c94a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:46Z,use_quota=True,user_id='89c67ee931d34fa1b2cbaa2796cd1353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f8a2b6e-3284-4b7d-bb83-fd3d4d5d187c),volume_type_id=0f8a2b6e-3284-4b7d-bb83-fd3d4d5d187c)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ca5ad6-8d0f-4ff2-ae19-13ec1a017ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ca5ad6-8d0f-4ff2-ae19-13ec1a017ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6033c4c-ca34-425b-948d-7663d2762f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6033c4c-ca34-425b-948d-7663d2762f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3', 'volume_name': 'volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476eed58-7c6f-40e3-818f-5a54b11c1f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476eed58-7c6f-40e3-818f-5a54b11c1f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5d83da-4d96-4d8c-8581-e5ca5f86ebdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Volume 0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3', 'volume_size': 1}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-878948335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc134cef9c78485b93c820917c94a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:46Z,use_quota=True,user_id='89c67ee931d34fa1b2cbaa2796cd1353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f8a2b6e-3284-4b7d-bb83-fd3d4d5d187c),volume_type_id=0f8a2b6e-3284-4b7d-bb83-fd3d4d5d187c)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Creating volume 0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:25:46 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:46 devstack sudo[97058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 1073741824
Nov 06 08:25:46 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-925b71b6-6c50-453a-8601-9e81931394bd-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Flow 'volume_create_manager' (a86c5f41-6380-4b5a-afb2-8a8797d32620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be86f6a-8123-4c02-84d8-01e312a5422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-925b71b6-6c50-453a-8601-9e81931394bd-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be86f6a-8123-4c02-84d8-01e312a5422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1151715506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc134cef9c78485b93c820917c94a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:47Z,use_quota=True,user_id='89c67ee931d34fa1b2cbaa2796cd1353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51f27271-d9e3-425f-bb69-8d7c70d32fcb),volume_type_id=51f27271-d9e3-425f-bb69-8d7c70d32fcb)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808c20b9-32ee-4fc2-b5fd-315887a58a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808c20b9-32ee-4fc2-b5fd-315887a58a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbefcba-6b7f-4e25-9812-2950037f3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbefcba-6b7f-4e25-9812-2950037f3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d', 'volume_name': 'volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc648eb8-e662-4f9c-85cb-8f797557636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc648eb8-e662-4f9c-85cb-8f797557636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801bd5af-54b9-4ab3-9bfa-b391228c3a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Volume ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d', 'volume_size': 1}
Nov 06 08:25:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-925b71b6-6c50-453a-8601-9e81931394bd" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-925b71b6-6c50-453a-8601-9e81931394bd" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:47 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 1073741824" returned: 0 in 0.756s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[81744528-9d3a-4c72-8b41-f6fc2056c9ba]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:47 devstack sudo[97066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3
Nov 06 08:25:47 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:47 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd
Nov 06 08:25:47 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:47 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3" returned: 0 in 0.429s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1151715506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc134cef9c78485b93c820917c94a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:47Z,use_quota=True,user_id='89c67ee931d34fa1b2cbaa2796cd1353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51f27271-d9e3-425f-bb69-8d7c70d32fcb),volume_type_id=51f27271-d9e3-425f-bb69-8d7c70d32fcb)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Creating volume ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:25:47 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:47 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5d83da-4d96-4d8c-8581-e5ca5f86ebdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:47 devstack sudo[97073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d 1073741824
Nov 06 08:25:47 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd02033b-1913-48fa-baf8-3d08c7038416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd" returned: 0 in 0.537s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:25:47 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd
Nov 06 08:25:47 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Flow 'volume_create_manager' (66774683-0b25-4ec0-81e5-bf76d5dca149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f132f444-8b12-49a9-b25d-2e3c980a2966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:47 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Volume volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 (0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3): created successfully
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd02033b-1913-48fa-baf8-3d08c7038416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Flow 'volume_create_manager' (59f41c95-3177-447c-a058-22e9f24969cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f132f444-8b12-49a9-b25d-2e3c980a2966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-19391702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7d629e-853a-4b19-8023-0bb644885078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc134cef9c78485b93c820917c94a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:48Z,use_quota=True,user_id='89c67ee931d34fa1b2cbaa2796cd1353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56dda89b-e65b-4db2-a20f-c72fcd4dcb52),volume_type_id=56dda89b-e65b-4db2-a20f-c72fcd4dcb52)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94166a17-1df9-4b99-9a52-7179b6cacbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94166a17-1df9-4b99-9a52-7179b6cacbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340eb936-2d90-4c66-8d38-b39b5ea8556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:25:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1b5ca3a0-abe7-4a44-a8bd-94d2326b0823 tempest-TestInstancesWithCinderVolumes-771470515 None] Created volume successfully.
Nov 06 08:25:47 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-925b71b6-6c50-453a-8601-9e81931394bd" returned: 0 in 0.272s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-925b71b6-6c50-453a-8601-9e81931394bd" released by "delete_volume" :: held 0.964s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['46741470-9b1a-4ab6-b994-56f6d710fceb', 'aafda789-f1c8-4226-9c82-36e655d44e5c', 'bcbbb9bf-caae-4287-a207-a83ca476ce50', '8757d263-06fc-45c7-bd62-d675625c81c8'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:48 devstack sudo[97084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:48 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340eb936-2d90-4c66-8d38-b39b5ea8556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c7d629e-853a-4b19-8023-0bb644885078', 'volume_name': 'volume-0c7d629e-853a-4b19-8023-0bb644885078', 'volume_size': 1, 'image_id': '389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1811198654', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc134cef9c78485b93c820917c94a2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'created_at': datetime.datetime(2026, 11, 6, 7, 25, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 25, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd1070542c0>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dc2cfc-8232-4a63-98df-97e48bea1d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dc2cfc-8232-4a63-98df-97e48bea1d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7a52f7-5a3e-4b64-8965-6dacadf7f5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Volume 0c7d629e-853a-4b19-8023-0bb644885078: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c7d629e-853a-4b19-8023-0bb644885078', 'volume_size': 1, 'image_id': '389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1811198654', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc134cef9c78485b93c820917c94a2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'created_at': datetime.datetime(2026, 11, 6, 7, 25, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 25, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd1070542c0>}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Trying to clone 0c7d629e-853a-4b19-8023-0bb644885078 from image 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:25:48 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d 1073741824" returned: 0 in 0.808s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:48 devstack sudo[97086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d
Nov 06 08:25:48 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:48 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.435s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Deleted volume successfully.
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77c9ee36-d653-41fd-b94d-5e972e83d6db tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-925b71b6-6c50-453a-8601-9e81931394bd-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:48 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d" returned: 0 in 0.461s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801bd5af-54b9-4ab3-9bfa-b391228c3a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf17c2ac-6d37-4802-baa1-1ccd6529f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Volume volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d (ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d): created successfully
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf17c2ac-6d37-4802-baa1-1ccd6529f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Flow 'volume_create_manager' (a86c5f41-6380-4b5a-afb2-8a8797d32620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7c238526-dbed-42ff-a208-0b46017dbccf tempest-TestInstancesWithCinderVolumes-771470515 None] Created volume successfully.
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-cd5c5332-f649-42d2-aeb0-60bd1ca23768-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-cd5c5332-f649-42d2-aeb0-60bd1ca23768-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "cinder-quobyte-cd5c5332-f649-42d2-aeb0-60bd1ca23768" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-cd5c5332-f649-42d2-aeb0-60bd1ca23768" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[78da411a-ec79-4786-979b-cab1188fcaf3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:49 devstack sudo[97090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768
Nov 06 08:25:49 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Flow 'volume_create_manager' (76efaf3f-8e77-4dd4-8cdb-1024145fd41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27996498-f4a2-4850-be46-d0390b65d2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27996498-f4a2-4850-be46-d0390b65d2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1716164188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7703d2a8f3645fdb2ca603d8cac7088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:50Z,use_quota=True,user_id='0a351939d6b74d2b9183746d5d2737a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b98c4da-e60a-4daa-a1a2-dd171c7279ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b98c4da-e60a-4daa-a1a2-dd171c7279ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d23ddf3-a1cb-44d4-a941-dcc38123d409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d23ddf3-a1cb-44d4-a941-dcc38123d409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d', 'volume_name': 'volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:49 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e5ce4a-ddaf-4f9f-81a3-a87b2ec4f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e5ce4a-ddaf-4f9f-81a3-a87b2ec4f14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7e5c8b-2da8-4169-bff1-7236a63ed089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Volume fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d', 'volume_size': 1}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1716164188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7703d2a8f3645fdb2ca603d8cac7088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:50Z,use_quota=True,user_id='0a351939d6b74d2b9183746d5d2737a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Creating volume fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:25:49 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768" returned: 0 in 0.655s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:49 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d 1073741824
Nov 06 08:25:49 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:49 devstack sudo[97097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768
Nov 06 08:25:49 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:50 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cd5c5332-f649-42d2-aeb0-60bd1ca23768" returned: 0 in 0.359s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-quobyte-cd5c5332-f649-42d2-aeb0-60bd1ca23768" released by "delete_volume" :: held 1.111s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Created reservations ['739506f8-f317-4ce0-bbaa-e0b04ecc48ef', '6c9424af-7f8c-437a-a95a-de6ad42f1ca4', '9d924407-4678-4fd4-9b5d-b02eb9c15650', 'ef9a0396-7bdf-40f6-a363-0b3974c92ca0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:50 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d 1073741824" returned: 0 in 0.493s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:50 devstack sudo[97105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d
Nov 06 08:25:50 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:50 devstack sudo[97107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:50 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:50 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d" returned: 0 in 0.462s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:50 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.407s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Deleted volume successfully.
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7e5c8b-2da8-4169-bff1-7236a63ed089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b7b7b3-7fd8-44b8-8986-76cef7b2c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:25:50 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Volume volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d (fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d): created successfully
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b7b7b3-7fd8-44b8-8986-76cef7b2c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Flow 'volume_create_manager' (76efaf3f-8e77-4dd4-8cdb-1024145fd41e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:25:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c532104a-9df3-4073-98c4-a53a999a825d tempest-VolumesSnapshotTestJSON-437827459 None] Lock "cinder-cd5c5332-f649-42d2-aeb0-60bd1ca23768-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:51 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-01806ad6-06d6-44b7-8ee6-2195cde1a184 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Created volume successfully.
Nov 06 08:25:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-58c380e6-14e2-4a66-ab93-872a6d17f02d req-8025d821-dd5a-4098-a9cb-94fb522fb9bd tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-58c380e6-14e2-4a66-ab93-872a6d17f02d req-8025d821-dd5a-4098-a9cb-94fb522fb9bd tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-58c380e6-14e2-4a66-ab93-872a6d17f02d req-8025d821-dd5a-4098-a9cb-94fb522fb9bd tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-58c380e6-14e2-4a66-ab93-872a6d17f02d req-8025d821-dd5a-4098-a9cb-94fb522fb9bd tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36399801-8c31-4702-9bc7-00800a3ed793', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:25:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-58c380e6-14e2-4a66-ab93-872a6d17f02d req-8025d821-dd5a-4098-a9cb-94fb522fb9bd tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] attachment_update completed successfully.
Nov 06 08:25:53 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD, size 20.69 MB, duration 5.42 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:25:53 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Image download 20.69 MB at 3.82 MB/s
Nov 06 08:25:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d663624-dba9-4976-8928-3f1ffcd6ca51]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:54 devstack sudo[97540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD
Nov 06 08:25:54 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:54 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Temporary image 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 is fetched for user 89c67ee931d34fa1b2cbaa2796cd1353. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34f62fc-2224-45d4-a200-1b701875c8e6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:54 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD
Nov 06 08:25:54 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:54 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-19391702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7d629e-853a-4b19-8023-0bb644885078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc134cef9c78485b93c820917c94a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:25:48Z,use_quota=True,user_id='89c67ee931d34fa1b2cbaa2796cd1353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56dda89b-e65b-4db2-a20f-c72fcd4dcb52),volume_type_id=56dda89b-e65b-4db2-a20f-c72fcd4dcb52)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Creating volume 0c7d629e-853a-4b19-8023-0bb644885078 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:25:54 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:25:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:54 devstack sudo[97550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 1073741824
Nov 06 08:25:54 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:55 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 1073741824" returned: 0 in 0.518s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:55 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078
Nov 06 08:25:55 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:55 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078" returned: 0 in 0.295s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Attempting download of 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 ((None, [{'url': 'file:///opt/stack/data/glance/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'metadata': {}}])) to volume 0c7d629e-853a-4b19-8023-0bb644885078. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c9b6a-f93d-4098-b95a-c69cf779cf75]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_dl3fynqj {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:56 devstack sudo[97559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_dl3fynqj
Nov 06 08:25:56 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:56 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_dl3fynqj" returned: 0 in 0.455s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_dl3fynqj {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:56 devstack sudo[97563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_dl3fynqj
Nov 06 08:25:56 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:56 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_dl3fynqj" returned: 1 in 0.451s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_dl3fynqj' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:25:56 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b53c545-cc87-4cba-b7cc-fe783022baa0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:56 devstack sudo[97570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD
Nov 06 08:25:56 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-82d358b9-a4d1-40a4-a3e6-bb59e6cc17a9 req-f447dead-810b-467e-a607-a084ac300689 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Terminate volume connection completed successfully.
Nov 06 08:25:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-82d358b9-a4d1-40a4-a3e6-bb59e6cc17a9 req-f447dead-810b-467e-a607-a084ac300689 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Deleting attachment 36399801-8c31-4702-9bc7-00800a3ed793. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:25:57 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD" returned: 0 in 0.540s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 was qcow2, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:57 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078
Nov 06 08:25:57 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Acquiring lock "cinder-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "cinder-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Acquiring lock "cinder-quobyte-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "cinder-quobyte-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d" acquired by "delete_volume" :: waited 0.031s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90261f7-9c49-438a-a5a9-8c8ecaa7e29b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:25:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:58 devstack sudo[97610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d
Nov 06 08:25:58 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:58 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d" returned: 0 in 0.590s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:58 devstack sudo[97617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d
Nov 06 08:25:58 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:58 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d" returned: 0 in 0.352s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "cinder-quobyte-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d" released by "delete_volume" :: held 1.013s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:58 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Created reservations ['0cf5089d-c7cd-408d-8bb4-3bfccc81486c', '30516c1d-f342-45cf-b21b-a75fbd85c705', 'a46eda2f-a370-4552-9f3c-afe8a7a6c41b', '3ab878e6-30a7-4f8b-b13b-1dcd4e78affe'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:59 devstack sudo[97620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:25:59 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:25:59 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.291s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:25:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Deleted volume successfully.
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae3e6b4-96a3-4076-973c-09b9ad869018 tempest-TestServerVolumeAttachScenarioOldVersion-1527350870 None] Lock "cinder-fa5d412f-3d9f-4a4d-a8b4-9d1ae894b84d-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:25:59 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078" returned: 0 in 2.655s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2_igv58bk_devstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:25:59 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Converted 112.00 MB image at 42.16 MB/s
Nov 06 08:25:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:25:59 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 1G
Nov 06 08:25:59 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:00 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 1G" returned: 0 in 0.550s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Downloaded image 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 ((None, [{'url': 'file:///opt/stack/data/glance/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'metadata': {}}])) to volume 0c7d629e-853a-4b19-8023-0bb644885078 successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Temporary image 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 for user 89c67ee931d34fa1b2cbaa2796cd1353 is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Marking volume 0c7d629e-853a-4b19-8023-0bb644885078 as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Copying metadata from image 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 to 0c7d629e-853a-4b19-8023-0bb644885078. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Creating volume glance metadata for volume 0c7d629e-853a-4b19-8023-0bb644885078 backed by image 389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2 with: {'image_id': '389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'image_name': 'tempest-scenario-img--1811198654', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7a52f7-5a3e-4b64-8965-6dacadf7f5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7d629e-853a-4b19-8023-0bb644885078', 'volume_size': 1, 'image_id': '389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1811198654', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc134cef9c78485b93c820917c94a2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2', 'created_at': datetime.datetime(2026, 11, 6, 7, 25, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 25, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/389aaa3e-3c3b-464c-89bd-3cd71b0a8ef2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd1070542c0>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbd6f0b-5cde-4d2a-b469-e42f880167a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:00 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Volume volume-0c7d629e-853a-4b19-8023-0bb644885078 (0c7d629e-853a-4b19-8023-0bb644885078): created successfully
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbd6f0b-5cde-4d2a-b469-e42f880167a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Flow 'volume_create_manager' (66774683-0b25-4ec0-81e5-bf76d5dca149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-48c3008e-736b-4cfd-9696-6de58e90284b tempest-TestInstancesWithCinderVolumes-771470515 None] Created volume successfully.
Nov 06 08:26:01 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Flow 'volume_create_manager' (a9f4114b-2440-4fd5-b546-d3bf69c58c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80069fe-7d9a-4ba9-83c8-5ac6c95d0f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80069fe-7d9a-4ba9-83c8-5ac6c95d0f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-779402829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1a5c35-1223-41fb-8d2c-67870c66931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee48fc30004cafa242a4ae146402bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:02Z,use_quota=True,user_id='31e3b0c1c88a47aab42b8e22bb995863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078cfff7-577f-439c-9d57-20ee6bf4c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078cfff7-577f-439c-9d57-20ee6bf4c197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495928e1-c310-4f7f-a2fc-0fcda7fab824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495928e1-c310-4f7f-a2fc-0fcda7fab824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1a5c35-1223-41fb-8d2c-67870c66931e', 'volume_name': 'volume-3f1a5c35-1223-41fb-8d2c-67870c66931e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a2506-6859-4197-85f6-7705739c44e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a2506-6859-4197-85f6-7705739c44e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0493b60-cc89-4e9b-9ae9-eeb0e13df290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:02 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Volume 3f1a5c35-1223-41fb-8d2c-67870c66931e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1a5c35-1223-41fb-8d2c-67870c66931e', 'volume_size': 1}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-779402829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1a5c35-1223-41fb-8d2c-67870c66931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee48fc30004cafa242a4ae146402bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:02Z,use_quota=True,user_id='31e3b0c1c88a47aab42b8e22bb995863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Creating volume 3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:26:02 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:02 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e 1073741824
Nov 06 08:26:02 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:02 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e 1073741824" returned: 0 in 0.543s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:02 devstack sudo[97657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e
Nov 06 08:26:02 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:02 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e" returned: 0 in 0.292s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:26:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0493b60-cc89-4e9b-9ae9-eeb0e13df290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1a5c35-1223-41fb-8d2c-67870c66931e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fae360-a884-47a0-a075-80c976d1fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:03 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Volume volume-3f1a5c35-1223-41fb-8d2c-67870c66931e (3f1a5c35-1223-41fb-8d2c-67870c66931e): created successfully
Nov 06 08:26:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fae360-a884-47a0-a075-80c976d1fad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Flow 'volume_create_manager' (a9f4114b-2440-4fd5-b546-d3bf69c58c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:03 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f42ea963-fb1f-442b-b1a0-adf2e4583249 tempest-VolumesSnapshotListTestJSON-933788608 None] Created volume successfully.
Nov 06 08:26:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Creating offline snapshot 8876c7cc-5823-4a18-ad5d-3f376f5bab40 of volume 3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:26:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d18ff7-d773-4517-baea-96868b6f6140]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:04 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e
Nov 06 08:26:04 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:05 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e" returned: 0 in 0.693s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:05 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 1G
Nov 06 08:26:05 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:05 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 1G" returned: 0 in 0.584s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:05 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40
Nov 06 08:26:05 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:06 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40" returned: 0 in 0.426s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:06 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 is being set with open permissions: ugo+rw
Nov 06 08:26:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:06 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40
Nov 06 08:26:06 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:06 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40" returned: 0 in 0.438s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:06 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.info
Nov 06 08:26:06 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:06 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.info" returned: 0 in 0.370s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:06 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.info is being set with open permissions: ugo+rw
Nov 06 08:26:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:06 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.info
Nov 06 08:26:07 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-4650a713-8570-4d71-863c-63cdaaf3ba06 req-33e768c6-1a87-4cdb-a3f5-60c3d72ce6fa tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:07 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.info" returned: 0 in 0.393s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.034s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-4650a713-8570-4d71-863c-63cdaaf3ba06 req-33e768c6-1a87-4cdb-a3f5-60c3d72ce6fa tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.254s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-4650a713-8570-4d71-863c-63cdaaf3ba06 req-33e768c6-1a87-4cdb-a3f5-60c3d72ce6fa tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-caf438f1-e012-4138-a4cd-350707d3bc7d tempest-VolumesSnapshotListTestJSON-933788608 None] Create snapshot completed successfully
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-4650a713-8570-4d71-863c-63cdaaf3ba06 req-33e768c6-1a87-4cdb-a3f5-60c3d72ce6fa tempest-TestInstancesWithCinderVolumes-771470515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-0c7d629e-853a-4b19-8023-0bb644885078', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0c25344-740e-46f4-bdbb-af23a87f3c30', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:26:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-4650a713-8570-4d71-863c-63cdaaf3ba06 req-33e768c6-1a87-4cdb-a3f5-60c3d72ce6fa tempest-TestInstancesWithCinderVolumes-771470515 None] attachment_update completed successfully.
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Creating offline snapshot fcf646cc-7f66-4fc8-913e-9d5d54160947 of volume 3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:26:08 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01c107f-e7a6-4681-9eb7-d3f74c46998d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:08 devstack sudo[97740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40
Nov 06 08:26:08 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:08 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40" returned: 0 in 0.481s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a5c35-1223-41fb-8d2c-67870c66931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:08 devstack sudo[97745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 1G
Nov 06 08:26:08 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:09 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 1G" returned: 0 in 0.723s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:09 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947
Nov 06 08:26:09 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:09 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947" returned: 0 in 0.387s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:09 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 is being set with open permissions: ugo+rw
Nov 06 08:26:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:09 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947
Nov 06 08:26:09 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:09 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947" returned: 0 in 0.278s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2e9a6465-875d-4df1-af17-e452fd4a654e tempest-VolumesSnapshotListTestJSON-933788608 None] Create snapshot completed successfully
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Creating offline snapshot df14a6df-b36c-4530-b28e-9047ea593b49 of volume 3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa85742-c5fb-48a8-8c76-297e96319efc]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:11 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947
Nov 06 08:26:11 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:11 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947" returned: 0 in 0.425s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a5c35-1223-41fb-8d2c-67870c66931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:11 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 1G
Nov 06 08:26:11 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:12 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 1G" returned: 0 in 0.490s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:12 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49
Nov 06 08:26:12 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:12 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49" returned: 0 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:12 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 is being set with open permissions: ugo+rw
Nov 06 08:26:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:12 devstack sudo[97783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49
Nov 06 08:26:12 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:13 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49" returned: 0 in 0.351s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:13 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9687ad71-6bf2-4986-b209-18b1cb2f2d3c tempest-VolumesSnapshotListTestJSON-933788608 None] Create snapshot completed successfully
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-df14a6df-b36c-4530-b28e-9047ea593b49-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-df14a6df-b36c-4530-b28e-9047ea593b49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-quobyte-df14a6df-b36c-4530-b28e-9047ea593b49" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-df14a6df-b36c-4530-b28e-9047ea593b49" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Deleting offline snapshot df14a6df-b36c-4530-b28e-9047ea593b49 of volume 3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:26:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] snapshot_file for this snap is: volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:26:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[88367903-9842-4ff1-bd29-e0403067d214]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:16 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49
Nov 06 08:26:16 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:16 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49" returned: 0 in 0.620s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a5c35-1223-41fb-8d2c-67870c66931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee57b92-329b-4c7d-81f6-55f9b78c4ac9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:16 devstack sudo[98278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947
Nov 06 08:26:16 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:17 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947" returned: 0 in 0.567s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a5c35-1223-41fb-8d2c-67870c66931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:17 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49
Nov 06 08:26:17 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:17 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49" returned: 0 in 0.668s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:18 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49
Nov 06 08:26:18 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:18 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.df14a6df-b36c-4530-b28e-9047ea593b49" returned: 0 in 0.495s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-df14a6df-b36c-4530-b28e-9047ea593b49" released by "_delete_snapshot" :: held 2.670s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" released by "delete_snapshot" :: held 2.723s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:18 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Created reservations ['c83d18c9-edb9-45e3-a97f-3abeb2cb6f8f', 'c78862ea-7f7f-4036-96ec-d6153db12550', '5619e52d-7a9a-41a4-96dc-dc6827f29360', '2e94b76d-1bfc-42a2-a4c2-f7e41d4f6919'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Delete snapshot completed successfully.
Nov 06 08:26:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-653c01dd-4e16-43aa-a48b-98057d63fd12 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-df14a6df-b36c-4530-b28e-9047ea593b49-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-fcf646cc-7f66-4fc8-913e-9d5d54160947-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-fcf646cc-7f66-4fc8-913e-9d5d54160947-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-quobyte-fcf646cc-7f66-4fc8-913e-9d5d54160947" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-fcf646cc-7f66-4fc8-913e-9d5d54160947" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Deleting offline snapshot fcf646cc-7f66-4fc8-913e-9d5d54160947 of volume 3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] snapshot_file for this snap is: volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe20e2f-3f69-4d00-b64f-6cb20d987e22]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:19 devstack sudo[98315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947
Nov 06 08:26:19 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:20 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947" returned: 0 in 0.701s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a5c35-1223-41fb-8d2c-67870c66931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce328af2-f09e-4f96-8632-500128ec473b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:20 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40
Nov 06 08:26:20 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:20 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40" returned: 0 in 0.616s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a5c35-1223-41fb-8d2c-67870c66931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:20 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947
Nov 06 08:26:20 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:21 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947" returned: 0 in 0.581s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:21 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947
Nov 06 08:26:21 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:21 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.fcf646cc-7f66-4fc8-913e-9d5d54160947" returned: 0 in 0.364s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-fcf646cc-7f66-4fc8-913e-9d5d54160947" released by "_delete_snapshot" :: held 2.450s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" released by "delete_snapshot" :: held 2.489s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:21 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Created reservations ['09a907fc-507a-4f00-9928-781ab85ac23d', '2cc9acda-0fec-488c-9224-709d6bdc8d0a', 'e6021a4b-2597-4bd7-abcc-7ee37c4f8096', 'ff568880-4f30-426f-a8ae-0a8fc0e5e7db'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Delete snapshot completed successfully.
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ccf9fc25-978a-4738-b290-d9f4e8a40a33 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-fcf646cc-7f66-4fc8-913e-9d5d54160947-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-8876c7cc-5823-4a18-ad5d-3f376f5bab40-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-8876c7cc-5823-4a18-ad5d-3f376f5bab40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-quobyte-8876c7cc-5823-4a18-ad5d-3f376f5bab40" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-8876c7cc-5823-4a18-ad5d-3f376f5bab40" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Deleting offline snapshot 8876c7cc-5823-4a18-ad5d-3f376f5bab40 of volume 3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] snapshot_file for this snap is: volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2353d-1475-44b0-82eb-fc3d7f56e8ea]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:22 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40
Nov 06 08:26:22 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:23 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40" returned: 0 in 0.575s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a5c35-1223-41fb-8d2c-67870c66931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2e571-a9c2-4638-9d3b-8f3f36b95f98]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:23 devstack sudo[98341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e
Nov 06 08:26:23 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:23 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e" returned: 0 in 0.550s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:24 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40
Nov 06 08:26:24 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:25 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40" returned: 0 in 1.169s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:25 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40
Nov 06 08:26:25 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:25 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e.8876c7cc-5823-4a18-ad5d-3f376f5bab40" returned: 0 in 0.600s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-8876c7cc-5823-4a18-ad5d-3f376f5bab40" released by "_delete_snapshot" :: held 3.117s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" released by "delete_snapshot" :: held 3.166s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:25 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Created reservations ['2a2976b0-e298-4739-95cf-cd0214cea7f6', '523e19dd-e974-48a8-995e-513a57d2925e', 'cb42f415-0db1-487b-a55a-5b3020d66f69', '92c73145-01b4-4636-9f78-51b19bc6f490'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Delete snapshot completed successfully.
Nov 06 08:26:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28ebf8a2-efd2-406e-8116-c7fa7db0fde4 tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-8876c7cc-5823-4a18-ad5d-3f376f5bab40-delete_snapshot" released by "delete_snapshot" :: held 3.480s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-3f1a5c35-1223-41fb-8d2c-67870c66931e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-3f1a5c35-1223-41fb-8d2c-67870c66931e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" acquired by "delete_volume" :: waited 0.041s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[86235f09-4efa-416b-8993-8cd82c100ee1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:28 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e
Nov 06 08:26:28 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:28 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e" returned: 0 in 0.870s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:28 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e
Nov 06 08:26:28 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:29 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3f1a5c35-1223-41fb-8d2c-67870c66931e" returned: 0 in 0.651s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-quobyte-3f1a5c35-1223-41fb-8d2c-67870c66931e" released by "delete_volume" :: held 1.718s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Created reservations ['a7678508-996f-4fa6-aebd-40e2adc80c10', '6938cf4e-66f4-4b2f-9c29-4e29f85d44e1', '7302047a-755a-4e85-b045-9685ac9be95c', 'b79e6bc9-2a66-4cdb-8e41-774ab8c340b2'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:30 devstack sudo[98436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:26:30 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:30 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:26:30 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:30 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.806s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:26:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Deleted volume successfully.
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cc2f39b7-faa7-4cd2-b110-65c5919c0a6d tempest-VolumesSnapshotListTestJSON-933788608 None] Lock "cinder-3f1a5c35-1223-41fb-8d2c-67870c66931e-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:30 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.524s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:26:31 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:26:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:26:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Flow 'volume_create_manager' (c93bb732-1a0c-416d-b216-a28f55dc37cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e4d9b5-0420-414c-9377-fa5311a2c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e4d9b5-0420-414c-9377-fa5311a2c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1270624765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6117df-466a-4f90-987b-f4fd2aa37f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88316788ebb64df5aadb487284e9b367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:38Z,use_quota=True,user_id='64b5dc9e69404a108990a69027a2c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5600d8a-8e3f-4ee4-8bb9-cc0be906fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5600d8a-8e3f-4ee4-8bb9-cc0be906fef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9ac88c-d2cb-4b75-afb3-d8f30c3b01e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9ac88c-d2cb-4b75-afb3-d8f30c3b01e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6117df-466a-4f90-987b-f4fd2aa37f9b', 'volume_name': 'volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b', 'volume_size': 2}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c713d3ce-09c0-44d3-9c94-00a1bcc22662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c713d3ce-09c0-44d3-9c94-00a1bcc22662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d88558-c75c-4dcd-bc7b-9555b7abea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Volume 0c6117df-466a-4f90-987b-f4fd2aa37f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b', 'volume_size': 2}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1270624765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6117df-466a-4f90-987b-f4fd2aa37f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88316788ebb64df5aadb487284e9b367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:38Z,use_quota=True,user_id='64b5dc9e69404a108990a69027a2c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Creating volume 0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:26:37 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:26:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b 2147483648 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:37 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b 2147483648
Nov 06 08:26:37 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:38 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b 2147483648" returned: 0 in 0.570s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=107,cinder:INSERT=35,cinder:SELECT=85,cinder:DELETE=6 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:38 devstack sudo[98496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b
Nov 06 08:26:38 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:38 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b" returned: 0 in 0.290s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=99,cinder:UPDATE=89,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d88558-c75c-4dcd-bc7b-9555b7abea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b', 'volume_size': 2}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72644b11-2dc0-42c7-b262-825c3091007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:38 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Volume volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b (0c6117df-466a-4f90-987b-f4fd2aa37f9b): created successfully
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72644b11-2dc0-42c7-b262-825c3091007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Flow 'volume_create_manager' (c93bb732-1a0c-416d-b216-a28f55dc37cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-241a7b0a-54ca-4b4f-b182-dfe54231ac1d tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Created volume successfully.
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Flow 'volume_create_manager' (13eec88c-c315-4c66-be66-4d01f1cb2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e242f3-0be0-47b5-afdd-1786144093c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e242f3-0be0-47b5-afdd-1786144093c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd086a9-9c68-44b5-aa17-b8d71750da85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a51d228b7514358a7b8662110634041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:39Z,use_quota=True,user_id='689d3be23a814de2aa266df870dc720b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acde0b13-463a-42c7-948e-a5afe985088d),volume_type_id=acde0b13-463a-42c7-948e-a5afe985088d)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6defc16-056d-4807-b43d-d71c228418d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6defc16-056d-4807-b43d-d71c228418d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7039aaaa-e839-4f7d-9d23-1b6b6aacbc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7039aaaa-e839-4f7d-9d23-1b6b6aacbc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5cd086a9-9c68-44b5-aa17-b8d71750da85', 'volume_name': 'volume-5cd086a9-9c68-44b5-aa17-b8d71750da85', 'volume_size': 1, 'image_id': 'c9e0079c-e64a-436c-a76d-b655e3007c7b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9e0079c-e64a-436c-a76d-b655e3007c7b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4a8fa326c9cbcad2db3ff731b3b3c47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a51d228b7514358a7b8662110634041', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '823519b6c21a766ed42ccfaae23fd600d34cd3f3f6c53892823b368838611236c36eb49bc0a0804758c456eb294522784eb687bda827e583b15bd755b43f8dda', 'id': 'c9e0079c-e64a-436c-a76d-b655e3007c7b', 'created_at': datetime.datetime(2026, 11, 6, 7, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9e0079c-e64a-436c-a76d-b655e3007c7b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd106e3e990>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b209f39-dd51-4fe7-b37d-b2afadb167a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b209f39-dd51-4fe7-b37d-b2afadb167a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1599d516-8818-4c60-857b-1f4f80eecb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:39 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Volume 5cd086a9-9c68-44b5-aa17-b8d71750da85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5cd086a9-9c68-44b5-aa17-b8d71750da85', 'volume_size': 1, 'image_id': 'c9e0079c-e64a-436c-a76d-b655e3007c7b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9e0079c-e64a-436c-a76d-b655e3007c7b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4a8fa326c9cbcad2db3ff731b3b3c47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a51d228b7514358a7b8662110634041', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '823519b6c21a766ed42ccfaae23fd600d34cd3f3f6c53892823b368838611236c36eb49bc0a0804758c456eb294522784eb687bda827e583b15bd755b43f8dda', 'id': 'c9e0079c-e64a-436c-a76d-b655e3007c7b', 'created_at': datetime.datetime(2026, 11, 6, 7, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9e0079c-e64a-436c-a76d-b655e3007c7b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd106e3e990>}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Trying to clone 5cd086a9-9c68-44b5-aa17-b8d71750da85 from image c9e0079c-e64a-436c-a76d-b655e3007c7b at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9e0079c-e64a-436c-a76d-b655e3007c7b', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:26:39 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2244fe0a-0757-4b1c-9cc4-9f8e16ecb661]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:39 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD
Nov 06 08:26:39 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:39 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Creating offline snapshot 7be06e74-0bf7-4031-bd4a-db47d72b831d of volume 0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:26:40 devstack sudo[98503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD
Nov 06 08:26:40 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aaf262-17b0-4fa3-841a-d8dff7aba9d6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:40 devstack sudo[98505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b
Nov 06 08:26:40 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:40 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Temporary image c9e0079c-e64a-436c-a76d-b655e3007c7b is fetched for user 689d3be23a814de2aa266df870dc720b. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[872fb4a8-6889-4829-8786-d55b2b406360]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:40 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b" returned: 0 in 0.397s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d 2G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:40 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d 2G
Nov 06 08:26:40 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:40 devstack sudo[98512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD
Nov 06 08:26:40 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:40 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:41 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD
Nov 06 08:26:41 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:41 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d 2G" returned: 0 in 0.497s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:41 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d
Nov 06 08:26:41 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:41 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:41 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d" returned: 0 in 0.350s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:41 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d is being set with open permissions: ugo+rw
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:41 devstack sudo[98549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d
Nov 06 08:26:41 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:41 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:41 devstack sudo[98552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.info
Nov 06 08:26:41 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:41 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.info" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:41 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.info is being set with open permissions: ugo+rw
Nov 06 08:26:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:41 devstack sudo[98555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.info
Nov 06 08:26:41 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:42 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.info" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd086a9-9c68-44b5-aa17-b8d71750da85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a51d228b7514358a7b8662110634041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:39Z,use_quota=True,user_id='689d3be23a814de2aa266df870dc720b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acde0b13-463a-42c7-948e-a5afe985088d),volume_type_id=acde0b13-463a-42c7-948e-a5afe985088d)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Creating volume 5cd086a9-9c68-44b5-aa17-b8d71750da85 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:26:42 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:42 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 1073741824
Nov 06 08:26:42 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bcabe5b2-59f7-43b7-978b-0dec8fcf53bc tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Create snapshot completed successfully
Nov 06 08:26:42 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 1073741824" returned: 0 in 0.465s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:42 devstack sudo[98564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85
Nov 06 08:26:42 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:42 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85" returned: 0 in 0.275s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:26:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Attempting download of c9e0079c-e64a-436c-a76d-b655e3007c7b ((None, [{'url': 'file:///opt/stack/data/glance/images/c9e0079c-e64a-436c-a76d-b655e3007c7b', 'metadata': {}}])) to volume 5cd086a9-9c68-44b5-aa17-b8d71750da85. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[279e7f7c-c5e9-49af-bdcd-6262b8d7c0c0]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9e0079c-e64a-436c-a76d-b655e3007c7b_evv_zwcz {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:43 devstack sudo[98567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9e0079c-e64a-436c-a76d-b655e3007c7b_evv_zwcz
Nov 06 08:26:43 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "cinder-7be06e74-0bf7-4031-bd4a-db47d72b831d-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-7be06e74-0bf7-4031-bd4a-db47d72b831d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "cinder-quobyte-0c6117df-466a-4f90-987b-f4fd2aa37f9b" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-quobyte-0c6117df-466a-4f90-987b-f4fd2aa37f9b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "cinder-quobyte-7be06e74-0bf7-4031-bd4a-db47d72b831d" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:43 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9e0079c-e64a-436c-a76d-b655e3007c7b_evv_zwcz" returned: 0 in 0.377s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9e0079c-e64a-436c-a76d-b655e3007c7b_evv_zwcz {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-quobyte-7be06e74-0bf7-4031-bd4a-db47d72b831d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Deleting offline snapshot 7be06e74-0bf7-4031-bd4a-db47d72b831d of volume 0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] snapshot_file for this snap is: volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d83caf-3d20-40a6-b698-58fafaa801a1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:43 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9e0079c-e64a-436c-a76d-b655e3007c7b_evv_zwcz
Nov 06 08:26:43 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:43 devstack sudo[98572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d
Nov 06 08:26:43 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:43 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9e0079c-e64a-436c-a76d-b655e3007c7b_evv_zwcz" returned: 1 in 0.353s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9e0079c-e64a-436c-a76d-b655e3007c7b_evv_zwcz' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9022efad-6352-47c6-80fb-6a73cbeab203]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:43 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD
Nov 06 08:26:43 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:43 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d" returned: 0 in 0.430s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cb463c-b799-4b11-873d-61dde394f6fc]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:44 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b
Nov 06 08:26:44 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:44 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:44 devstack sudo[98595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD
Nov 06 08:26:44 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:44 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b" returned: 0 in 0.428s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:44 devstack sudo[98600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d
Nov 06 08:26:44 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:44 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] c9e0079c-e64a-436c-a76d-b655e3007c7b was raw, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:44 devstack sudo[98605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85
Nov 06 08:26:44 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:44 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:44 devstack sudo[98610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d
Nov 06 08:26:44 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:45 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85" returned: 0 in 0.449s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9e0079c-e64a-436c-a76d-b655e3007c7b_jmc7wcv1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:26:45 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 08:26:45 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b.7be06e74-0bf7-4031-bd4a-db47d72b831d" returned: 0 in 0.262s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:45 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 1G
Nov 06 08:26:45 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-quobyte-7be06e74-0bf7-4031-bd4a-db47d72b831d" released by "_delete_snapshot" :: held 1.614s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-quobyte-0c6117df-466a-4f90-987b-f4fd2aa37f9b" released by "delete_snapshot" :: held 1.659s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Created reservations ['e55b9dc6-a94e-4647-a873-70f8c245150e', '27f44686-4953-4ff1-9c75-66b8674d787c', '320e5c00-7b46-4a05-9c4c-0194e6011031', '2cf79764-3f49-4d62-b597-0460148f6fad'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Delete snapshot completed successfully.
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c9e7f19-4dd8-4de4-88bd-23b700216fc9 tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-7be06e74-0bf7-4031-bd4a-db47d72b831d-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:45 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 1G" returned: 0 in 0.329s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Downloaded image c9e0079c-e64a-436c-a76d-b655e3007c7b ((None, [{'url': 'file:///opt/stack/data/glance/images/c9e0079c-e64a-436c-a76d-b655e3007c7b', 'metadata': {}}])) to volume 5cd086a9-9c68-44b5-aa17-b8d71750da85 successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Temporary image c9e0079c-e64a-436c-a76d-b655e3007c7b for user 689d3be23a814de2aa266df870dc720b is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Marking volume 5cd086a9-9c68-44b5-aa17-b8d71750da85 as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Copying metadata from image c9e0079c-e64a-436c-a76d-b655e3007c7b to 5cd086a9-9c68-44b5-aa17-b8d71750da85. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Creating volume glance metadata for volume 5cd086a9-9c68-44b5-aa17-b8d71750da85 backed by image c9e0079c-e64a-436c-a76d-b655e3007c7b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c9e0079c-e64a-436c-a76d-b655e3007c7b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f4a8fa326c9cbcad2db3ff731b3b3c47', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1599d516-8818-4c60-857b-1f4f80eecb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd086a9-9c68-44b5-aa17-b8d71750da85', 'volume_size': 1, 'image_id': 'c9e0079c-e64a-436c-a76d-b655e3007c7b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9e0079c-e64a-436c-a76d-b655e3007c7b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4a8fa326c9cbcad2db3ff731b3b3c47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a51d228b7514358a7b8662110634041', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '823519b6c21a766ed42ccfaae23fd600d34cd3f3f6c53892823b368838611236c36eb49bc0a0804758c456eb294522784eb687bda827e583b15bd755b43f8dda', 'id': 'c9e0079c-e64a-436c-a76d-b655e3007c7b', 'created_at': datetime.datetime(2026, 11, 6, 7, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9e0079c-e64a-436c-a76d-b655e3007c7b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd106e3e990>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0ee598-effb-4ad6-b24e-8dd445fc2c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Volume volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 (5cd086a9-9c68-44b5-aa17-b8d71750da85): created successfully
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0ee598-effb-4ad6-b24e-8dd445fc2c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Flow 'volume_create_manager' (13eec88c-c315-4c66-be66-4d01f1cb2a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-261ee79e-18a6-4c77-9ae6-1203daa56224 tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Created volume successfully.
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "cinder-0c6117df-466a-4f90-987b-f4fd2aa37f9b-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-0c6117df-466a-4f90-987b-f4fd2aa37f9b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "cinder-quobyte-0c6117df-466a-4f90-987b-f4fd2aa37f9b" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-quobyte-0c6117df-466a-4f90-987b-f4fd2aa37f9b" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1807aadd-1236-4dd0-bb07-c39499853cc7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:45 devstack sudo[98625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b
Nov 06 08:26:45 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:46 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:46 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b
Nov 06 08:26:46 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:46 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c6117df-466a-4f90-987b-f4fd2aa37f9b" returned: 0 in 0.277s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-quobyte-0c6117df-466a-4f90-987b-f4fd2aa37f9b" released by "delete_volume" :: held 0.760s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Created reservations ['13d1aa94-e63b-4bb5-9d9a-2657eb382696', 'a770e765-9323-4154-a67a-2b5842d7f63f', 'b60d8f87-d49a-4e84-8225-bcf7601f8bf3', 'df8fea43-f616-4833-83f2-dfc6a869ca56'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Acquiring lock "cinder-5cd086a9-9c68-44b5-aa17-b8d71750da85-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "cinder-5cd086a9-9c68-44b5-aa17-b8d71750da85-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:46 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:26:46 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Acquiring lock "cinder-quobyte-5cd086a9-9c68-44b5-aa17-b8d71750da85" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "cinder-quobyte-5cd086a9-9c68-44b5-aa17-b8d71750da85" acquired by "delete_volume" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-33ecb49e-d6c4-44be-8d44-ef6bec64cb44 req-837ab7e1-483b-4cef-8aea-850bbf6db0f6 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-33ecb49e-d6c4-44be-8d44-ef6bec64cb44 req-837ab7e1-483b-4cef-8aea-850bbf6db0f6 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3110f45e-fc8a-40d0-a25d-c6b383a2b65c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-33ecb49e-d6c4-44be-8d44-ef6bec64cb44 req-837ab7e1-483b-4cef-8aea-850bbf6db0f6 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-33ecb49e-d6c4-44be-8d44-ef6bec64cb44 req-837ab7e1-483b-4cef-8aea-850bbf6db0f6 tempest-TestInstancesWithCinderVolumes-771470515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e819d7c-2507-40cc-9e95-4d19f3180be1', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:26:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-33ecb49e-d6c4-44be-8d44-ef6bec64cb44 req-837ab7e1-483b-4cef-8aea-850bbf6db0f6 tempest-TestInstancesWithCinderVolumes-771470515 None] attachment_update completed successfully.
Nov 06 08:26:47 devstack sudo[98649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85
Nov 06 08:26:47 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:47 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.438s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:47 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:26:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Deleted volume successfully.
Nov 06 08:26:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc571df7-ad02-4455-932c-edfd20a37b1f tempest-VolumesSnapshotNegativeTestJSON-596008514 None] Lock "cinder-0c6117df-466a-4f90-987b-f4fd2aa37f9b-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:47 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85" returned: 0 in 0.597s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:47 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85
Nov 06 08:26:47 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:47 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5cd086a9-9c68-44b5-aa17-b8d71750da85" returned: 0 in 0.497s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "cinder-quobyte-5cd086a9-9c68-44b5-aa17-b8d71750da85" released by "delete_volume" :: held 1.188s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:47 devstack cinder-volume[87143]: WARNING cinder.quota [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:26:47 devstack cinder-volume[87143]: WARNING cinder.quota [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Created reservations ['e79d8483-bd47-4950-bd56-082290550436', '21c2f893-7726-4e72-95d9-42b307e7c07a', '0ce822fd-c58f-4c62-8352-68e3698f7cb2', 'a1c49085-4667-4d0b-9814-5cc5ac43edd1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:48 devstack sudo[98660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:26:48 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:48 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.296s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:26:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Deleted volume successfully.
Nov 06 08:26:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8623816e-e3a7-4328-ae12-4fa139c3758d tempest-VolumeAndVolumeTypeFromImageTest-544312465 None] Lock "cinder-5cd086a9-9c68-44b5-aa17-b8d71750da85-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-c4a4145c-f8b0-4ba4-9ea3-49243476eb1b req-8ec5e4e9-8820-4d2f-b4c1-f50dc9bc4734 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-c4a4145c-f8b0-4ba4-9ea3-49243476eb1b req-8ec5e4e9-8820-4d2f-b4c1-f50dc9bc4734 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-c4a4145c-f8b0-4ba4-9ea3-49243476eb1b req-8ec5e4e9-8820-4d2f-b4c1-f50dc9bc4734 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-c4a4145c-f8b0-4ba4-9ea3-49243476eb1b req-8ec5e4e9-8820-4d2f-b4c1-f50dc9bc4734 tempest-TestInstancesWithCinderVolumes-771470515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed3aca1c-0462-4933-98ce-84cd58df8932', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:26:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-c4a4145c-f8b0-4ba4-9ea3-49243476eb1b req-8ec5e4e9-8820-4d2f-b4c1-f50dc9bc4734 tempest-TestInstancesWithCinderVolumes-771470515 None] attachment_update completed successfully.
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Flow 'volume_create_manager' (4809c5c2-cb20-4561-9ce5-744f44893252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c07f878-b7ce-42fd-ae78-71ff61c80b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c07f878-b7ce-42fd-ae78-71ff61c80b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-48225254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355fa877-2ba3-47dd-85c7-4c3e367a8c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85e86d84d154551979c543f4370dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:54Z,use_quota=True,user_id='ff3789fde1364c019abf06ae4df29693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea804a7-1563-4ee0-a67b-4192afe2c4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea804a7-1563-4ee0-a67b-4192afe2c4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0bb98a-114a-4ecb-83a8-6a7b7e266009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0bb98a-114a-4ecb-83a8-6a7b7e266009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355fa877-2ba3-47dd-85c7-4c3e367a8c5e', 'volume_name': 'volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62786e22-8e8e-43e8-8ee4-3dd26bb6f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62786e22-8e8e-43e8-8ee4-3dd26bb6f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78863950-81c1-4c7a-ad0c-c2adcae882d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:53 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Volume 355fa877-2ba3-47dd-85c7-4c3e367a8c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e', 'volume_size': 1}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-48225254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355fa877-2ba3-47dd-85c7-4c3e367a8c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85e86d84d154551979c543f4370dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:54Z,use_quota=True,user_id='ff3789fde1364c019abf06ae4df29693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Creating volume 355fa877-2ba3-47dd-85c7-4c3e367a8c5e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:26:53 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:26:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:53 devstack sudo[98698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e 1073741824
Nov 06 08:26:53 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:54 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e 1073741824" returned: 0 in 0.558s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:54 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e
Nov 06 08:26:54 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:54 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e" returned: 0 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78863950-81c1-4c7a-ad0c-c2adcae882d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf930846-f631-4855-a9d9-5294c0597278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:54 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Volume volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e (355fa877-2ba3-47dd-85c7-4c3e367a8c5e): created successfully
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf930846-f631-4855-a9d9-5294c0597278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Flow 'volume_create_manager' (4809c5c2-cb20-4561-9ce5-744f44893252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fcdb994c-613d-4115-b13b-8cdd43c0727d tempest-AttachVolumeTestJSON-954746583 None] Created volume successfully.
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (5328a42d-9a95-4463-bb73-8bf2eab4fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38add0d6-0147-467b-911c-a62ca4b44b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38add0d6-0147-467b-911c-a62ca4b44b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283931733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eb4b47-e310-43b2-9d7a-58ba7c5998e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:55Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0838a9d8-84bc-43fc-a781-6ace7ca535b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0838a9d8-84bc-43fc-a781-6ace7ca535b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cf65d2-b714-4b20-ace2-76b1e7feb8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cf65d2-b714-4b20-ace2-76b1e7feb8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29eb4b47-e310-43b2-9d7a-58ba7c5998e4', 'volume_name': 'volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80849b5b-f8ca-46e4-a01f-e12549590f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80849b5b-f8ca-46e4-a01f-e12549590f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfa90e5-06d9-4db9-bc40-123daf16df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:55 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume 29eb4b47-e310-43b2-9d7a-58ba7c5998e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4', 'volume_size': 1}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283931733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eb4b47-e310-43b2-9d7a-58ba7c5998e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:26:55Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Creating volume 29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:26:55 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:26:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:55 devstack sudo[98731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 1073741824
Nov 06 08:26:55 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-2e38d20a-ecd0-42f0-9ec0-f18a815c4973 req-37280c08-9ff4-423e-b78f-25aaea404a9d tempest-TestInstancesWithCinderVolumes-771470515 None] Terminate volume connection completed successfully.
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-2e38d20a-ecd0-42f0-9ec0-f18a815c4973 req-37280c08-9ff4-423e-b78f-25aaea404a9d tempest-TestInstancesWithCinderVolumes-771470515 None] Deleting attachment 4e819d7c-2507-40cc-9e95-4d19f3180be1. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:26:56 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 1073741824" returned: 0 in 0.618s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:56 devstack sudo[98739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4
Nov 06 08:26:56 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:56 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" returned: 0 in 0.432s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfa90e5-06d9-4db9-bc40-123daf16df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa7f430-9d29-49bf-9d4e-5c02aa89204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:26:56 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 (29eb4b47-e310-43b2-9d7a-58ba7c5998e4): created successfully
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa7f430-9d29-49bf-9d4e-5c02aa89204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (5328a42d-9a95-4463-bb73-8bf2eab4fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:26:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0246a112-2e0a-4cf2-bf3c-aa4da9615b28 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created volume successfully.
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "cinder-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "cinder-quobyte-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:26:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-quobyte-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9767bb95-1b4b-4fec-8721-4649162397c8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:57 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3
Nov 06 08:26:57 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-12f6df65-79ae-4f53-adee-ca46afb43299 req-3a936f05-53e3-405b-9c97-3716f949cdc6 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-12f6df65-79ae-4f53-adee-ca46afb43299 req-3a936f05-53e3-405b-9c97-3716f949cdc6 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-12f6df65-79ae-4f53-adee-ca46afb43299 req-3a936f05-53e3-405b-9c97-3716f949cdc6 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-12f6df65-79ae-4f53-adee-ca46afb43299 req-3a936f05-53e3-405b-9c97-3716f949cdc6 tempest-AttachVolumeTestJSON-954746583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ed38be8-bf14-4426-be65-2a65759bf231', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:26:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-12f6df65-79ae-4f53-adee-ca46afb43299 req-3a936f05-53e3-405b-9c97-3716f949cdc6 tempest-AttachVolumeTestJSON-954746583 None] attachment_update completed successfully.
Nov 06 08:26:57 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3" returned: 0 in 0.508s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:57 devstack sudo[98764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3
Nov 06 08:26:57 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:58 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3" returned: 0 in 0.715s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-quobyte-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3" released by "delete_volume" :: held 1.305s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Creating offline snapshot f1886981-4444-4229-bc8d-15ec5bd685f4 of volume 29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:26:58 devstack cinder-volume[87143]: WARNING cinder.quota [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-150744211-1953942522 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-150744211-1953942522, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:26:58 devstack cinder-volume[87143]: WARNING cinder.quota [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-150744211-1953942522 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-150744211-1953942522, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[da913948-907a-4a97-8e88-54c3d8bf80c7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Created reservations ['86936cc2-672a-4a1b-bd91-12d87dc14a1e', '777e5962-1505-4809-b5e3-8b2590832064', '5d0b63c2-4f75-4804-b751-fe34413cac23', '8b6482fe-4bc5-446d-b155-c57d05a89469'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:58 devstack sudo[98770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:26:58 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:58 devstack sudo[98769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4
Nov 06 08:26:58 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:26:58 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.398s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:58 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:26:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Deleted volume successfully.
Nov 06 08:26:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aa6e5089-cbd5-462d-bb67-14fb021f2610 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-0d84f1ff-cf28-4afc-ae12-3a95ae4fdbf3-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:26:59 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root
Nov 06 08:26:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" returned: 0 in 0.898s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:26:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:26:59 devstack sudo[98777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 1G
Nov 06 08:26:59 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:00 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 1G" returned: 0 in 0.717s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:00 devstack sudo[98791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4
Nov 06 08:27:00 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:00 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4" returned: 0 in 0.423s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:00 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 is being set with open permissions: ugo+rw
Nov 06 08:27:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:00 devstack sudo[98804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4
Nov 06 08:27:00 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:00 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4" returned: 0 in 0.352s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:00 devstack sudo[98815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.info
Nov 06 08:27:00 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:01 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.info" returned: 0 in 0.316s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:01 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.info is being set with open permissions: ugo+rw
Nov 06 08:27:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:01 devstack sudo[98822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.info
Nov 06 08:27:01 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:01 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.info" returned: 0 in 0.464s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.356s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9fc12fc3-b87d-4b3e-a2ca-c168d81920a8 tempest-CreateVolumesFromSnapshotTest-555261919 None] Create snapshot completed successfully
Nov 06 08:27:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-bc2ddc90-0066-4bea-857a-bc064ec7d584 req-fe2cbbe4-fb17-415e-b9bf-a1db36179c81 tempest-TestInstancesWithCinderVolumes-771470515 None] Terminate volume connection completed successfully.
Nov 06 08:27:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-bc2ddc90-0066-4bea-857a-bc064ec7d584 req-fe2cbbe4-fb17-415e-b9bf-a1db36179c81 tempest-TestInstancesWithCinderVolumes-771470515 None] Deleting attachment ed3aca1c-0462-4933-98ce-84cd58df8932. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:27:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "cinder-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "cinder-quobyte-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-quobyte-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5bfd9-0602-4d03-88e9-923a58b74a26]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (a714a2dd-6c2f-4e9f-adfe-3851c0a7aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7472446-977e-448f-9ab3-a6992a9dc837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7472446-977e-448f-9ab3-a6992a9dc837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70292597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9a5045-2326-4a5b-bfbd-153947d24c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:03Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e635f188-dc57-479b-8d8c-cb5e21de4334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e635f188-dc57-479b-8d8c-cb5e21de4334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651bdb5c-cb32-4a10-9922-5fbc1149ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651bdb5c-cb32-4a10-9922-5fbc1149ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9a5045-2326-4a5b-bfbd-153947d24c67', 'volume_name': 'volume-da9a5045-2326-4a5b-bfbd-153947d24c67', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbc61bc-dc40-4281-a17c-27351a89a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbc61bc-dc40-4281-a17c-27351a89a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:03 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa466c7-fc48-421a-895b-9683999387e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:03 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume da9a5045-2326-4a5b-bfbd-153947d24c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9a5045-2326-4a5b-bfbd-153947d24c67', 'volume_size': 1}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70292597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9a5045-2326-4a5b-bfbd-153947d24c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:03Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Creating volume da9a5045-2326-4a5b-bfbd-153947d24c67 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:03 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:03 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:03 devstack sudo[98847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67 1073741824
Nov 06 08:27:03 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:04 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d" returned: 0 in 0.854s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:04 devstack sudo[98859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d
Nov 06 08:27:04 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (5e63f4fa-54a0-4436-9826-6013fb8c2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3530887-3c01-436d-85ab-d81dcde392ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3530887-3c01-436d-85ab-d81dcde392ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51477471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5184336e-bab0-4a79-a85d-d59fffb52296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:04Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be44b7ef-89ee-4a65-8fba-8f8691b2ecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be44b7ef-89ee-4a65-8fba-8f8691b2ecc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5f39d6-3757-45ab-8d32-43d79835997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5f39d6-3757-45ab-8d32-43d79835997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5184336e-bab0-4a79-a85d-d59fffb52296', 'volume_name': 'volume-5184336e-bab0-4a79-a85d-d59fffb52296', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911dfc7e-e2f3-4e9a-941d-55cb1088b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911dfc7e-e2f3-4e9a-941d-55cb1088b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9012f19b-c809-4b59-8a3d-83625f4faef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:04 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume 5184336e-bab0-4a79-a85d-d59fffb52296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5184336e-bab0-4a79-a85d-d59fffb52296', 'volume_size': 1}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:04 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67 1073741824" returned: 0 in 1.021s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:04 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d" returned: 0 in 0.524s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-quobyte-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d" released by "delete_volume" :: held 1.507s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:04 devstack cinder-volume[87143]: WARNING cinder.quota [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2054566152-767477017 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2054566152-767477017, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:27:04 devstack cinder-volume[87143]: WARNING cinder.quota [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2054566152-767477017 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2054566152-767477017, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:27:04 devstack sudo[98870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67
Nov 06 08:27:04 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:04 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Created reservations ['2dd66aad-6bde-43c0-ae24-42d3fa78ce00', '0444fd1e-6390-43cc-8dbc-18517743493a', '1f1cea0a-2d8f-4db0-9a3f-674f64bddf08', 'd199bec4-7e47-4883-ac07-ac0ca34d503d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (30ca8daa-e0ce-40da-8617-6f9f87cfc6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63617bc-0081-4c41-b7ac-c7b17312bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:05 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67" returned: 0 in 0.631s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51477471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5184336e-bab0-4a79-a85d-d59fffb52296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:04Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Creating volume 5184336e-bab0-4a79-a85d-d59fffb52296 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:05 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:05 devstack sudo[98889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:05 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63617bc-0081-4c41-b7ac-c7b17312bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038959818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74e6c0f-c83a-4730-8bf3-25d7bf3724b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:05Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bf5a20-facb-45bf-b7f8-6a76636bb2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bf5a20-facb-45bf-b7f8-6a76636bb2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5528e5-bda9-4465-ba18-02ae1d183ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:05 devstack sudo[98895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296 1073741824
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5528e5-bda9-4465-ba18-02ae1d183ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74e6c0f-c83a-4730-8bf3-25d7bf3724b9', 'volume_name': 'volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:05 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6fce19-9f1f-4327-8555-aad0acb003bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6fce19-9f1f-4327-8555-aad0acb003bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37912a4-68fc-4a15-a763-fce7c77dc50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:05 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume f74e6c0f-c83a-4730-8bf3-25d7bf3724b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9', 'volume_size': 1}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa466c7-fc48-421a-895b-9683999387e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9a5045-2326-4a5b-bfbd-153947d24c67', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b74d80-aacb-4235-982b-6c426af19abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:05 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume volume-da9a5045-2326-4a5b-bfbd-153947d24c67 (da9a5045-2326-4a5b-bfbd-153947d24c67): created successfully
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b74d80-aacb-4235-982b-6c426af19abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (a714a2dd-6c2f-4e9f-adfe-3851c0a7aefe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f438241e-69b8-4bb5-bf1f-cb1ba45375cd tempest-CreateVolumesFromSnapshotTest-555261919 None] Created volume successfully.
Nov 06 08:27:05 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.748s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:05 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Deleted volume successfully.
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0df70abc-1dae-42aa-bc4b-9514aeadf4f2 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-ca92ab6b-27c5-4cdd-b4fa-dbbd4554663d-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:06 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296 1073741824" returned: 0 in 1.256s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (daba6960-cd97-43bc-bb33-21efdd223381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d66d18-f906-474c-a09b-c2b5044073e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d66d18-f906-474c-a09b-c2b5044073e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564708141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083e0dff-4007-47fe-b054-b6cff178040e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:06Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39143731-5f88-49ac-887b-f40c5c0dc506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39143731-5f88-49ac-887b-f40c5c0dc506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25998b6-fb14-4f53-9ef6-38193494c78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25998b6-fb14-4f53-9ef6-38193494c78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083e0dff-4007-47fe-b054-b6cff178040e', 'volume_name': 'volume-083e0dff-4007-47fe-b054-b6cff178040e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e4ee2-b309-4aa7-9305-e66b6541af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e4ee2-b309-4aa7-9305-e66b6541af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083336e0-c3a7-4b19-9889-64c7a947ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:06 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume 083e0dff-4007-47fe-b054-b6cff178040e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083e0dff-4007-47fe-b054-b6cff178040e', 'volume_size': 1}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:06 devstack sudo[98955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296
Nov 06 08:27:06 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (714bfdaa-f471-4e0d-a3b8-2412ec60278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596a4a80-a180-4f50-8d8d-bbf59d3fa8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:07 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596a4a80-a180-4f50-8d8d-bbf59d3fa8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491812300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5af751-d795-4ebf-9a4c-18daac17aaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:07Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9ba8ff-ec99-4dcf-8bd8-05545ec0a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9ba8ff-ec99-4dcf-8bd8-05545ec0a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ec6112-98f0-4474-9346-e6e2f7a1fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ec6112-98f0-4474-9346-e6e2f7a1fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c5af751-d795-4ebf-9a4c-18daac17aaae', 'volume_name': 'volume-2c5af751-d795-4ebf-9a4c-18daac17aaae', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5211292-8ed5-4ffc-a79f-ae1881169b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5211292-8ed5-4ffc-a79f-ae1881169b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea01d5c-58c0-4fcd-b23d-2bd373bedec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:07 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume 2c5af751-d795-4ebf-9a4c-18daac17aaae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c5af751-d795-4ebf-9a4c-18daac17aaae', 'volume_size': 1}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296" returned: 0 in 0.924s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] <== create_volume: return (2468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.337s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038959818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74e6c0f-c83a-4730-8bf3-25d7bf3724b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:05Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Creating volume f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:07 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:07 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 1073741824
Nov 06 08:27:07 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9012f19b-c809-4b59-8a3d-83625f4faef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5184336e-bab0-4a79-a85d-d59fffb52296', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd63306f-4ef1-4102-9fe8-5ba1577c0afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:07 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume volume-5184336e-bab0-4a79-a85d-d59fffb52296 (5184336e-bab0-4a79-a85d-d59fffb52296): created successfully
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd63306f-4ef1-4102-9fe8-5ba1577c0afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (5e63f4fa-54a0-4436-9826-6013fb8c2a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-607fa0cc-0e55-4045-988c-fb5f5b5738f1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created volume successfully.
Nov 06 08:27:08 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 1073741824" returned: 0 in 0.920s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:08 devstack sudo[99004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9
Nov 06 08:27:08 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:09 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9" returned: 0 in 0.443s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.425s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564708141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083e0dff-4007-47fe-b054-b6cff178040e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:06Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Creating volume 083e0dff-4007-47fe-b054-b6cff178040e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:09 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37912a4-68fc-4a15-a763-fce7c77dc50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2251b1-ce00-4b8d-ae5a-8ca685c691bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:09 devstack sudo[99009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e 1073741824
Nov 06 08:27:09 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:09 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 (f74e6c0f-c83a-4730-8bf3-25d7bf3724b9): created successfully
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2251b1-ce00-4b8d-ae5a-8ca685c691bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (30ca8daa-e0ce-40da-8617-6f9f87cfc6bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3b8b3f68-1c96-4841-86b7-10310afb301a tempest-CreateVolumesFromSnapshotTest-555261919 None] Created volume successfully.
Nov 06 08:27:10 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e 1073741824" returned: 0 in 1.131s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:10 devstack sudo[99034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e
Nov 06 08:27:10 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:10 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e" returned: 0 in 0.458s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.159s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491812300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5af751-d795-4ebf-9a4c-18daac17aaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb23625bdee4c6aac46bf4a0bbf788b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:07Z,use_quota=True,user_id='86c85ba597394055b4ccffb7bd4ca263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Creating volume 2c5af751-d795-4ebf-9a4c-18daac17aaae {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:10 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:10 devstack sudo[99038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae 1073741824
Nov 06 08:27:10 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083336e0-c3a7-4b19-9889-64c7a947ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083e0dff-4007-47fe-b054-b6cff178040e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0995cc-0de9-4f0d-bbc3-9c60bf077fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:10 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume volume-083e0dff-4007-47fe-b054-b6cff178040e (083e0dff-4007-47fe-b054-b6cff178040e): created successfully
Nov 06 08:27:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0995cc-0de9-4f0d-bbc3-9c60bf077fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (daba6960-cd97-43bc-bb33-21efdd223381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:11 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7f22793b-efbc-4e97-aadb-4d4412edacbc tempest-CreateVolumesFromSnapshotTest-555261919 None] Created volume successfully.
Nov 06 08:27:11 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae 1073741824" returned: 0 in 0.768s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:11 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae
Nov 06 08:27:11 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:12 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae" returned: 0 in 0.373s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea01d5c-58c0-4fcd-b23d-2bd373bedec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5af751-d795-4ebf-9a4c-18daac17aaae', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa20fa7-5124-4fe2-9795-8e3eb9ddb446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Volume volume-2c5af751-d795-4ebf-9a4c-18daac17aaae (2c5af751-d795-4ebf-9a4c-18daac17aaae): created successfully
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa20fa7-5124-4fe2-9795-8e3eb9ddb446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Flow 'volume_create_manager' (714bfdaa-f471-4e0d-a3b8-2412ec60278d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0caa295c-8d59-4412-88ca-ea2b5a60b272 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created volume successfully.
Nov 06 08:27:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-fc76d4a9-9594-4a0b-9edc-b644b34ca533 req-542c144b-30f8-4866-96d1-73aa9c745fa3 tempest-TestInstancesWithCinderVolumes-771470515 None] Terminate volume connection completed successfully.
Nov 06 08:27:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fc76d4a9-9594-4a0b-9edc-b644b34ca533 req-542c144b-30f8-4866-96d1-73aa9c745fa3 tempest-TestInstancesWithCinderVolumes-771470515 None] Deleting attachment a0c25344-740e-46f4-bdbb-af23a87f3c30. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-2c5af751-d795-4ebf-9a4c-18daac17aaae-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-2c5af751-d795-4ebf-9a4c-18daac17aaae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-2c5af751-d795-4ebf-9a4c-18daac17aaae" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-2c5af751-d795-4ebf-9a4c-18daac17aaae" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d2a96-4ac9-4bbb-b7c3-a7e44ab2b8d5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:13 devstack sudo[99054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae
Nov 06 08:27:13 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "cinder-0c7d629e-853a-4b19-8023-0bb644885078-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-0c7d629e-853a-4b19-8023-0bb644885078-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "cinder-quobyte-0c7d629e-853a-4b19-8023-0bb644885078" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-quobyte-0c7d629e-853a-4b19-8023-0bb644885078" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5ebe57-6377-4a97-834c-cb88fabb42b4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:14 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae" returned: 0 in 0.798s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:14 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078
Nov 06 08:27:14 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:14 devstack sudo[99060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae
Nov 06 08:27:14 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:14 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078" returned: 0 in 0.550s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:14 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2c5af751-d795-4ebf-9a4c-18daac17aaae" returned: 0 in 0.407s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:14 devstack sudo[99067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078
Nov 06 08:27:14 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-2c5af751-d795-4ebf-9a4c-18daac17aaae" released by "delete_volume" :: held 1.282s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created reservations ['7be60c57-1b42-4e00-8420-47811c124a90', '823878a7-72f9-4ed2-a5fd-f46017046a24', '67fb9ae2-e408-4b96-9381-33e31023cdd9', '0d18500e-afbf-4b19-a112-56634a4d3c6a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:15 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:15 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:15 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-0c7d629e-853a-4b19-8023-0bb644885078" returned: 0 in 0.425s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-quobyte-0c7d629e-853a-4b19-8023-0bb644885078" released by "delete_volume" :: held 1.086s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:15 devstack cinder-volume[87143]: WARNING cinder.quota [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-436869466-1500133360 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-436869466-1500133360, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:27:15 devstack cinder-volume[87143]: WARNING cinder.quota [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-436869466-1500133360 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-436869466-1500133360, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Created reservations ['c6fb9740-0c1f-49b4-907a-4edac99a2b9e', '06d406ef-37a8-49f8-85bf-10b0a2c729c3', '1fdb6646-331b-43ec-8374-52fdd93cca77', 'd1e0b39f-e597-4c78-8875-34f1864f42af'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:15 devstack sudo[99072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:15 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:15 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.452s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Deleted volume successfully.
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f49adcc4-e0c0-4b82-8620-15cd77df2818 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-2c5af751-d795-4ebf-9a4c-18daac17aaae-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-083e0dff-4007-47fe-b054-b6cff178040e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:15 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-083e0dff-4007-47fe-b054-b6cff178040e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.473s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Deleted volume successfully.
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1ed0686e-db95-451e-8c49-07c83b8e23b3 tempest-TestInstancesWithCinderVolumes-771470515 None] Lock "cinder-0c7d629e-853a-4b19-8023-0bb644885078-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-083e0dff-4007-47fe-b054-b6cff178040e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-083e0dff-4007-47fe-b054-b6cff178040e" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f266fbd-a011-41a2-8c9f-ec21d3243c03]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:16 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e
Nov 06 08:27:16 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e" returned: 0 in 0.522s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:16 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:16 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e
Nov 06 08:27:16 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:16 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-083e0dff-4007-47fe-b054-b6cff178040e" returned: 0 in 0.549s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-083e0dff-4007-47fe-b054-b6cff178040e" released by "delete_volume" :: held 1.143s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created reservations ['923f10c0-507d-4ef6-93fc-ac6aa1767864', 'cdbb1dc5-c9f8-4782-a71e-b11953877731', '67829193-28b1-4e76-b7b1-84d9f89fcd17', 'fc913e2c-9a8e-4f65-88f1-0115d547702d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:17 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:17 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:17 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.450s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Deleted volume successfully.
Nov 06 08:27:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f5530b0c-2f5d-444f-a2bf-ffaeedcfb8a5 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-083e0dff-4007-47fe-b054-b6cff178040e-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c50e14-a21b-4c65-9bfb-5423e0cd23fb]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:18 devstack sudo[99089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9
Nov 06 08:27:18 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:19 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9" returned: 0 in 0.709s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:19 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9
Nov 06 08:27:19 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:19 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9" returned: 0 in 0.459s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9" released by "delete_volume" :: held 1.243s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created reservations ['a79c7c1a-7372-4e73-8307-840cda8c6cbe', '1b15cd3c-3bce-4295-a862-ba738a931706', 'af6e3ed2-6ae3-43c3-8ea5-742314c5f04e', '5d6489e1-2a14-4af6-b318-0171e8c7b2a0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:19 devstack sudo[99106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:19 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:20 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.432s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Deleted volume successfully.
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-37557de3-22ac-42d7-b7b2-58136ee57ca1 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-f74e6c0f-c83a-4730-8bf3-25d7bf3724b9-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-5184336e-bab0-4a79-a85d-d59fffb52296-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-5184336e-bab0-4a79-a85d-d59fffb52296-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-5184336e-bab0-4a79-a85d-d59fffb52296" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-5184336e-bab0-4a79-a85d-d59fffb52296" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce00213-dcac-403d-9319-5cf7590f2804]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:20 devstack sudo[99115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296
Nov 06 08:27:20 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:21 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296" returned: 0 in 0.478s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:21 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296
Nov 06 08:27:21 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:21 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5184336e-bab0-4a79-a85d-d59fffb52296" returned: 0 in 0.312s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-5184336e-bab0-4a79-a85d-d59fffb52296" released by "delete_volume" :: held 0.887s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Created reservations ['8ca78541-00c4-4188-a54c-85aeadc722e8', 'a237045f-15e0-4551-9e25-d6ace7097e8c', '032943f9-75b9-49d2-bb49-16723fb241e8', '48a91afe-d15d-4ef0-8d08-73dce17ba3af'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:21 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:21 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-da9a5045-2326-4a5b-bfbd-153947d24c67-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-da9a5045-2326-4a5b-bfbd-153947d24c67-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-da9a5045-2326-4a5b-bfbd-153947d24c67" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-da9a5045-2326-4a5b-bfbd-153947d24c67" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c276a238-901c-41f1-8470-8ac86ba2dd5b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:22 devstack sudo[99125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67
Nov 06 08:27:22 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:22 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.439s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Deleted volume successfully.
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d09319ce-a933-4f5c-99ea-e7859ac6649a tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-5184336e-bab0-4a79-a85d-d59fffb52296-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:22 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67" returned: 0 in 0.409s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:22 devstack sudo[99132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67
Nov 06 08:27:22 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:22 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-da9a5045-2326-4a5b-bfbd-153947d24c67" returned: 0 in 0.266s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-da9a5045-2326-4a5b-bfbd-153947d24c67" released by "delete_volume" :: held 0.740s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created reservations ['32940836-7207-43f7-b889-b20874d3b11d', '1a09e1b1-d000-4575-8cee-cd6216b87d4d', '841ab8ba-8aa8-48e0-862b-988ec6bd81af', '64497a33-7cef-4fb7-b35d-c3e9f58009f3'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:22 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:22 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-f1886981-4444-4229-bc8d-15ec5bd685f4-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-f1886981-4444-4229-bc8d-15ec5bd685f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-f1886981-4444-4229-bc8d-15ec5bd685f4" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-f1886981-4444-4229-bc8d-15ec5bd685f4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Deleting offline snapshot f1886981-4444-4229-bc8d-15ec5bd685f4 of volume 29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] snapshot_file for this snap is: volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7fab7e-66c3-4995-be15-6f19255aa700]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:23 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.475s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Deleted volume successfully.
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-13a862c3-55da-45d6-ac9d-c14a2d1f7a68 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-da9a5045-2326-4a5b-bfbd-153947d24c67-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:23 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4
Nov 06 08:27:23 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:23 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4" returned: 0 in 0.458s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1764b39-9616-437e-a3dd-08494dc236b1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:23 devstack sudo[99144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4
Nov 06 08:27:23 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:24 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" returned: 0 in 0.475s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:24 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4
Nov 06 08:27:24 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:24 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:24 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4
Nov 06 08:27:24 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:25 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4.f1886981-4444-4229-bc8d-15ec5bd685f4" returned: 0 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-f1886981-4444-4229-bc8d-15ec5bd685f4" released by "_delete_snapshot" :: held 1.836s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" released by "delete_snapshot" :: held 1.861s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created reservations ['84f81168-ebbd-4db8-9294-ca69519da89c', '664b68b3-52f7-469b-a95e-8dd2384b96f1', 'ed74cf31-977f-4948-9643-2c2ff568dabe', 'f9129def-d466-4cb2-be87-11fcf7d654f2'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Delete snapshot completed successfully.
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0dc2a48c-29db-4a39-8dda-87b2c6ea9109 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-f1886981-4444-4229-bc8d-15ec5bd685f4-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-29eb4b47-e310-43b2-9d7a-58ba7c5998e4-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-29eb4b47-e310-43b2-9d7a-58ba7c5998e4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "cinder-quobyte-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9178bd-992f-4f53-b6bf-1928bb54965e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:25 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4
Nov 06 08:27:25 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:26 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" returned: 0 in 0.497s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:26 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4
Nov 06 08:27:26 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:26 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" returned: 0 in 0.282s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-quobyte-29eb4b47-e310-43b2-9d7a-58ba7c5998e4" released by "delete_volume" :: held 0.847s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Created reservations ['ea44b911-93cb-4063-8e45-9184dba5bfaa', '1ede53b6-f959-4d87-b25f-97bc6074d47e', '581f865a-19f3-4acd-98f3-530972c10947', '8324bdbc-8eb7-473c-b1fc-c938edcfd68d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:26 devstack sudo[99169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:26 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Flow 'volume_create_manager' (e9cd53da-4011-489d-838c-59e5ed6d3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bff2e2f-b5aa-4921-b23a-11b7ee978835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bff2e2f-b5aa-4921-b23a-11b7ee978835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-581656696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc6bdcb-f5d3-41c9-b0b5-49731db712ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8195457643d048da97966b60d9f6de63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:26Z,use_quota=True,user_id='e559d6b91f524f1399a3cff5f773a9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286601a6-5840-4837-8cc4-778456af7acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286601a6-5840-4837-8cc4-778456af7acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67c2870-aa98-4b19-944c-2c4d084ca8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:27:26 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.409s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Deleted volume successfully.
Nov 06 08:27:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-38bb343e-68eb-430a-88ba-031ab9b859a0 tempest-CreateVolumesFromSnapshotTest-555261919 None] Lock "cinder-29eb4b47-e310-43b2-9d7a-58ba7c5998e4-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67c2870-aa98-4b19-944c-2c4d084ca8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffc6bdcb-f5d3-41c9-b0b5-49731db712ce', 'volume_name': 'volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fccb9070>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cb7cb0-f2d0-4997-9994-afe152e03a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cb7cb0-f2d0-4997-9994-afe152e03a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36403e7e-d10c-4b1f-b537-e068923e508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:27 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Volume ffc6bdcb-f5d3-41c9-b0b5-49731db712ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fccb9070>}
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Trying to clone ffc6bdcb-f5d3-41c9-b0b5-49731db712ce from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:27:27 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[686bdcae-1f0e-4895-8e90-9126eee1013b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:27 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD
Nov 06 08:27:27 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:28 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a is fetched for user e559d6b91f524f1399a3cff5f773a9af. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc35a3a-8990-40e9-a7d9-6da90459c4b3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:28 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD
Nov 06 08:27:28 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:28 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-581656696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc6bdcb-f5d3-41c9-b0b5-49731db712ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8195457643d048da97966b60d9f6de63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:26Z,use_quota=True,user_id='e559d6b91f524f1399a3cff5f773a9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Creating volume ffc6bdcb-f5d3-41c9-b0b5-49731db712ce {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:28 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:28 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce 1073741824
Nov 06 08:27:28 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:29 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce 1073741824" returned: 0 in 0.622s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:29 devstack sudo[99193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce
Nov 06 08:27:29 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:29 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce" returned: 0 in 0.351s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:29 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Attempting download of b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume ffc6bdcb-f5d3-41c9-b0b5-49731db712ce. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a518c966-05f9-4d85-ac6d-554b8a8275f1]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_vemze83b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:30 devstack sudo[99196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_vemze83b
Nov 06 08:27:30 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:30 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:30 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:30 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_vemze83b" returned: 0 in 0.426s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_vemze83b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:30 devstack sudo[99202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_vemze83b
Nov 06 08:27:30 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-bb5cfde0-60ff-4f3c-93dd-cc536a64a1e0 req-e7f7e927-eafb-4add-b303-e4c4cb8f03f7 tempest-AttachVolumeTestJSON-954746583 None] Terminate volume connection completed successfully.
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-bb5cfde0-60ff-4f3c-93dd-cc536a64a1e0 req-e7f7e927-eafb-4add-b303-e4c4cb8f03f7 tempest-AttachVolumeTestJSON-954746583 None] Deleting attachment 7ed38be8-bf14-4426-be65-2a65759bf231. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:27:30 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.373s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:27:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:27:31 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_vemze83b" returned: 1 in 0.530s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_vemze83b' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b034fef5-75ca-4a1b-8b07-d8d37bf03c11]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:31 devstack sudo[99210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD
Nov 06 08:27:31 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:31 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] b5f6cea8-26cc-40f2-998e-90a6fcdc116a was qcow2, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:31 devstack sudo[99215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce
Nov 06 08:27:31 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:31 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (738e08f6-a61f-4c28-9165-e1399f48ac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bb50aa-4de1-4fe8-a98f-5b6405b0186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bb50aa-4de1-4fe8-a98f-5b6405b0186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040040447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5feec3b-cd9e-4295-8997-61319dfd5280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:32Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedb3f0f-d6f8-4c46-9ad3-7e4d2d297289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedb3f0f-d6f8-4c46-9ad3-7e4d2d297289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968844c2-3425-4ff6-82c0-021eb370cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968844c2-3425-4ff6-82c0-021eb370cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5feec3b-cd9e-4295-8997-61319dfd5280', 'volume_name': 'volume-a5feec3b-cd9e-4295-8997-61319dfd5280', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0986ba9b-da81-43df-b5bc-78be65144437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0986ba9b-da81-43df-b5bc-78be65144437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc895bf9-4fc4-412d-951b-ae03dd223d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:32 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume a5feec3b-cd9e-4295-8997-61319dfd5280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5feec3b-cd9e-4295-8997-61319dfd5280', 'volume_size': 1}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040040447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5feec3b-cd9e-4295-8997-61319dfd5280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:32Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Creating volume a5feec3b-cd9e-4295-8997-61319dfd5280 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:32 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:32 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280 1073741824
Nov 06 08:27:32 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:32 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280 1073741824" returned: 0 in 0.748s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:32 devstack sudo[99233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280
Nov 06 08:27:32 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:33 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280" returned: 0 in 0.303s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc895bf9-4fc4-412d-951b-ae03dd223d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5feec3b-cd9e-4295-8997-61319dfd5280', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5747227-3ea7-4d4a-a5d7-4535b54a069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:33 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume volume-a5feec3b-cd9e-4295-8997-61319dfd5280 (a5feec3b-cd9e-4295-8997-61319dfd5280): created successfully
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5747227-3ea7-4d4a-a5d7-4535b54a069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (738e08f6-a61f-4c28-9165-e1399f48ac16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6ab0837a-cb9e-452d-a81e-a68f23640b60 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created volume successfully.
Nov 06 08:27:33 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce" returned: 0 in 2.472s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f6cea8-26cc-40f2-998e-90a6fcdc116a_uaegzwpedevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:27:33 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Converted 112.00 MB image at 45.28 MB/s
Nov 06 08:27:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:33 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce 1G
Nov 06 08:27:33 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:34 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce 1G" returned: 0 in 0.583s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Downloaded image b5f6cea8-26cc-40f2-998e-90a6fcdc116a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}])) to volume ffc6bdcb-f5d3-41c9-b0b5-49731db712ce successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Temporary image b5f6cea8-26cc-40f2-998e-90a6fcdc116a for user e559d6b91f524f1399a3cff5f773a9af is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Marking volume ffc6bdcb-f5d3-41c9-b0b5-49731db712ce as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Copying metadata from image b5f6cea8-26cc-40f2-998e-90a6fcdc116a to ffc6bdcb-f5d3-41c9-b0b5-49731db712ce. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Creating volume glance metadata for volume ffc6bdcb-f5d3-41c9-b0b5-49731db712ce backed by image b5f6cea8-26cc-40f2-998e-90a6fcdc116a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36403e7e-d10c-4b1f-b537-e068923e508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce', 'volume_size': 1, 'image_id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '268996f9331c4f51a7287e36d4e81c84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f6cea8-26cc-40f2-998e-90a6fcdc116a', 'created_at': datetime.datetime(2026, 11, 6, 7, 11, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f6cea8-26cc-40f2-998e-90a6fcdc116a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fccb9070>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f77efe-3e5f-43bf-b351-936b76dfebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Volume volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce (ffc6bdcb-f5d3-41c9-b0b5-49731db712ce): created successfully
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f77efe-3e5f-43bf-b351-936b76dfebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Flow 'volume_create_manager' (e9cd53da-4011-489d-838c-59e5ed6d3913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4e13e9e9-f539-48a9-a8cd-d83d4baa0013 tempest-TestShelveInstance-629874385 None] Created volume successfully.
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (34fcca95-2a22-4e06-995a-a4f0d141e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0ce5dd-01ca-4307-ba59-b1152ce23cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0ce5dd-01ca-4307-ba59-b1152ce23cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910789556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a285c0-dcd4-4532-8fe7-62e1234ba130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:35Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443df8a9-53e2-4f52-8eeb-53cfd127e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443df8a9-53e2-4f52-8eeb-53cfd127e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021260d6-c1ec-4204-9a09-f865b3be6beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021260d6-c1ec-4204-9a09-f865b3be6beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a285c0-dcd4-4532-8fe7-62e1234ba130', 'volume_name': 'volume-90a285c0-dcd4-4532-8fe7-62e1234ba130', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6d7a4c-2079-453d-be89-b8b8ab0c96b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6d7a4c-2079-453d-be89-b8b8ab0c96b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d501c741-df34-4d65-9a88-8b1c58acf07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume 90a285c0-dcd4-4532-8fe7-62e1234ba130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a285c0-dcd4-4532-8fe7-62e1234ba130', 'volume_size': 1}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910789556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a285c0-dcd4-4532-8fe7-62e1234ba130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:35Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Creating volume 90a285c0-dcd4-4532-8fe7-62e1234ba130 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:35 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:35 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130 1073741824
Nov 06 08:27:35 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (5b1ff947-4648-4a39-9ec0-b83b29fb24e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7376d062-fe16-4a7d-b511-3e2a6a529f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7376d062-fe16-4a7d-b511-3e2a6a529f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-329407667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4f8e66-6279-4189-aa80-514f7a46105a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:35Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5098bf-0d30-4eb3-9103-238187c76dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5098bf-0d30-4eb3-9103-238187c76dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ac1a6c-76e1-41c7-972d-d505f2395640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ac1a6c-76e1-41c7-972d-d505f2395640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4f8e66-6279-4189-aa80-514f7a46105a', 'volume_name': 'volume-ef4f8e66-6279-4189-aa80-514f7a46105a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55da7b1-9cc4-4572-aea3-983708229abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55da7b1-9cc4-4572-aea3-983708229abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28130ae-ec75-4cb3-8451-d68e5894903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume ef4f8e66-6279-4189-aa80-514f7a46105a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4f8e66-6279-4189-aa80-514f7a46105a', 'volume_size': 1}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:35 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130 1073741824" returned: 0 in 0.716s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:35 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130
Nov 06 08:27:35 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (acaa56ea-cc4e-4b1d-ac95-42eede88e809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13125536-013f-44ee-86da-c65f67af8a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13125536-013f-44ee-86da-c65f67af8a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148286652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a4ca5e-3541-4a73-b8c1-9e81499f2275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:36Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ef3ede-084a-48a8-9ed8-78bedb0310ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ef3ede-084a-48a8-9ed8-78bedb0310ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5ec3b0-8991-401e-8ad9-c8e50c3775e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5ec3b0-8991-401e-8ad9-c8e50c3775e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a4ca5e-3541-4a73-b8c1-9e81499f2275', 'volume_name': 'volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f278588b-ed32-4c58-bd40-a2d680603629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f278588b-ed32-4c58-bd40-a2d680603629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeb0b21-5119-4735-ad9f-e327ffeba996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume 62a4ca5e-3541-4a73-b8c1-9e81499f2275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275', 'volume_size': 1}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130" returned: 0 in 0.467s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-329407667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4f8e66-6279-4189-aa80-514f7a46105a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:35Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Creating volume ef4f8e66-6279-4189-aa80-514f7a46105a {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:36 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d501c741-df34-4d65-9a88-8b1c58acf07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a285c0-dcd4-4532-8fe7-62e1234ba130', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e808ace-06cc-4d48-98b7-782e455fdb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack sudo[99265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a 1073741824
Nov 06 08:27:36 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:36 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume volume-90a285c0-dcd4-4532-8fe7-62e1234ba130 (90a285c0-dcd4-4532-8fe7-62e1234ba130): created successfully
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e808ace-06cc-4d48-98b7-782e455fdb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (34fcca95-2a22-4e06-995a-a4f0d141e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fe057bb6-1924-4799-8f47-ef88b8e5826c tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created volume successfully.
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (8270b0ff-e7c0-43b5-b5aa-c0c5e00a5359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c928e4-49e8-4f6a-9622-bee41d3fa76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c928e4-49e8-4f6a-9622-bee41d3fa76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1665799311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8260e5a-084a-4377-9225-239b0e69d952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:37Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27ddbde-b397-4c9f-85aa-8be483f4b38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27ddbde-b397-4c9f-85aa-8be483f4b38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27f86c9-7e37-4cb5-b90e-d7886d3e5851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27f86c9-7e37-4cb5-b90e-d7886d3e5851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8260e5a-084a-4377-9225-239b0e69d952', 'volume_name': 'volume-a8260e5a-084a-4377-9225-239b0e69d952', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9c6426-ed3b-4987-bd37-68d978eeeaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9c6426-ed3b-4987-bd37-68d978eeeaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687b439f-4e31-4737-ba08-540d7f400d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume a8260e5a-084a-4377-9225-239b0e69d952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8260e5a-084a-4377-9225-239b0e69d952', 'volume_size': 1}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:37 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a 1073741824" returned: 0 in 0.902s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:37 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a
Nov 06 08:27:37 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:37 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a" returned: 0 in 0.376s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148286652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a4ca5e-3541-4a73-b8c1-9e81499f2275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:36Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Creating volume 62a4ca5e-3541-4a73-b8c1-9e81499f2275 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:37 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:37 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275 1073741824
Nov 06 08:27:37 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28130ae-ec75-4cb3-8451-d68e5894903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4f8e66-6279-4189-aa80-514f7a46105a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be47648-9a74-4d89-b943-e8588e0605d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume volume-ef4f8e66-6279-4189-aa80-514f7a46105a (ef4f8e66-6279-4189-aa80-514f7a46105a): created successfully
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be47648-9a74-4d89-b943-e8588e0605d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (5b1ff947-4648-4a39-9ec0-b83b29fb24e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (fcbeb5bb-d62c-4d90-bfb9-b9ddf6c4f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98e7ded-95df-4c66-b33e-6c9bc744cca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:37 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-20384d91-9a2c-4cca-95ec-7f31871cb626 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created volume successfully.
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98e7ded-95df-4c66-b33e-6c9bc744cca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766405508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7eccc6-da49-485d-8e08-eef036f98f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:38Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5f9130-5fdd-4666-bf03-c4d614777e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5f9130-5fdd-4666-bf03-c4d614777e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b7085c-fdb0-4c1f-84e2-6264320eb96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b7085c-fdb0-4c1f-84e2-6264320eb96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7eccc6-da49-485d-8e08-eef036f98f79', 'volume_name': 'volume-7c7eccc6-da49-485d-8e08-eef036f98f79', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09ab92e-d200-4ee8-8e14-6bcc6ea4b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09ab92e-d200-4ee8-8e14-6bcc6ea4b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9643993e-6a73-407b-986c-2d7a4b300aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:38 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume 7c7eccc6-da49-485d-8e08-eef036f98f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7eccc6-da49-485d-8e08-eef036f98f79', 'volume_size': 1}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:38 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275 1073741824" returned: 0 in 1.226s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:DELETE=16,cinder:UPDATE=151,cinder:SELECT=134,cinder:INSERT=43 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:27:38 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=146,cinder:SELECT=141,cinder:INSERT=46,cinder:DELETE=10 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:39 devstack sudo[99358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275
Nov 06 08:27:39 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:39 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275" returned: 0 in 0.491s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.434s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1665799311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8260e5a-084a-4377-9225-239b0e69d952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:37Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Creating volume a8260e5a-084a-4377-9225-239b0e69d952 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:39 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:39 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952 1073741824
Nov 06 08:27:39 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeb0b21-5119-4735-ad9f-e327ffeba996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0563a6-73d7-45e8-ab89-ca46cb2e5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:39 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275 (62a4ca5e-3541-4a73-b8c1-9e81499f2275): created successfully
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0563a6-73d7-45e8-ab89-ca46cb2e5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (acaa56ea-cc4e-4b1d-ac95-42eede88e809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bd3f162d-908c-4090-98e3-de89db74a3ce tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created volume successfully.
Nov 06 08:27:40 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952 1073741824" returned: 0 in 0.937s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:40 devstack sudo[99378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952
Nov 06 08:27:40 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:40 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952" returned: 0 in 0.368s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.772s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766405508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7eccc6-da49-485d-8e08-eef036f98f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc1d7f44d447a3a4a0e9f8f75c7cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:27:38Z,use_quota=True,user_id='5fcce9400c6c4ba0945e9ab9e3e51a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Creating volume 7c7eccc6-da49-485d-8e08-eef036f98f79 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:27:40 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687b439f-4e31-4737-ba08-540d7f400d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8260e5a-084a-4377-9225-239b0e69d952', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:40 devstack sudo[99381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79 1073741824
Nov 06 08:27:40 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b91bb4-adc1-4ec4-a2a3-fcc1d2903e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:40 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume volume-a8260e5a-084a-4377-9225-239b0e69d952 (a8260e5a-084a-4377-9225-239b0e69d952): created successfully
Nov 06 08:27:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b91bb4-adc1-4ec4-a2a3-fcc1d2903e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (8270b0ff-e7c0-43b5-b5aa-c0c5e00a5359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9b6ca4a2-1a31-4312-8a45-287293eb68f0 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created volume successfully.
Nov 06 08:27:41 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79 1073741824" returned: 0 in 0.915s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:41 devstack sudo[99393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79
Nov 06 08:27:41 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-7dd7dbd5-38d7-4763-bba4-06ba554376ef req-14faaaa5-52a6-46d9-aa2d-2ad0cc5ef999 tempest-TestShelveInstance-629874385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:42 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79" returned: 0 in 0.496s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-7dd7dbd5-38d7-4763-bba4-06ba554376ef req-14faaaa5-52a6-46d9-aa2d-2ad0cc5ef999 tempest-TestShelveInstance-629874385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.125s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9643993e-6a73-407b-986c-2d7a4b300aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7eccc6-da49-485d-8e08-eef036f98f79', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52de267-ff8a-475b-a1cb-bdc6daf1a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-7dd7dbd5-38d7-4763-bba4-06ba554376ef req-14faaaa5-52a6-46d9-aa2d-2ad0cc5ef999 tempest-TestShelveInstance-629874385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:42 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Volume volume-7c7eccc6-da49-485d-8e08-eef036f98f79 (7c7eccc6-da49-485d-8e08-eef036f98f79): created successfully
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52de267-ff8a-475b-a1cb-bdc6daf1a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Flow 'volume_create_manager' (fcbeb5bb-d62c-4d90-bfb9-b9ddf6c4f26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:27:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f5d35ea7-da27-4332-9584-4fbcc05e1de9 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created volume successfully.
Nov 06 08:27:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-7dd7dbd5-38d7-4763-bba4-06ba554376ef req-14faaaa5-52a6-46d9-aa2d-2ad0cc5ef999 tempest-TestShelveInstance-629874385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '311b3604-115d-47ec-8b5f-27d790c46e5a', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:27:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-7dd7dbd5-38d7-4763-bba4-06ba554376ef req-14faaaa5-52a6-46d9-aa2d-2ad0cc5ef999 tempest-TestShelveInstance-629874385 None] attachment_update completed successfully.
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-7c7eccc6-da49-485d-8e08-eef036f98f79-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-7c7eccc6-da49-485d-8e08-eef036f98f79-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-quobyte-7c7eccc6-da49-485d-8e08-eef036f98f79" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-7c7eccc6-da49-485d-8e08-eef036f98f79" acquired by "delete_volume" :: waited 0.075s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed529e75-9c11-43a3-a912-f5d11eb3f119]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:43 devstack sudo[99398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79
Nov 06 08:27:43 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:43 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79" returned: 0 in 0.587s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:44 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79
Nov 06 08:27:44 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:44 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7c7eccc6-da49-485d-8e08-eef036f98f79" returned: 0 in 0.296s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-7c7eccc6-da49-485d-8e08-eef036f98f79" released by "delete_volume" :: held 0.979s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created reservations ['02fc8d9a-f4a9-4dfc-abe9-c026a2eae91b', '3d5367e9-bc3a-444d-8b39-45e4772ff322', '133be2f0-d4f4-4197-8415-7a4ab7f347af', 'd75d7f3d-9953-48e2-9db4-f7aca0d08760'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:44 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:44 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:45 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.458s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Deleted volume successfully.
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6c59038c-798b-457a-aac8-24c5fe81fb40 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-7c7eccc6-da49-485d-8e08-eef036f98f79-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-a8260e5a-084a-4377-9225-239b0e69d952-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-a8260e5a-084a-4377-9225-239b0e69d952-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-quobyte-a8260e5a-084a-4377-9225-239b0e69d952" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-a8260e5a-084a-4377-9225-239b0e69d952" acquired by "delete_volume" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37c46a9-73e0-4ec5-ba68-6e49215e3d89]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:45 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952
Nov 06 08:27:45 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:46 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952" returned: 0 in 0.684s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:46 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952
Nov 06 08:27:46 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:47 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a8260e5a-084a-4377-9225-239b0e69d952" returned: 0 in 0.774s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-a8260e5a-084a-4377-9225-239b0e69d952" released by "delete_volume" :: held 1.548s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created reservations ['7ad14387-616b-4ee0-853a-df9b63b5408d', '20108dfc-70f4-4019-9a77-22ca35d977cc', '37bfcbaf-d424-4505-b06f-a326ca45cb4c', '5f5c22d9-fa9e-4218-8f30-3e68a718db36'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:47 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:47 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-62a4ca5e-3541-4a73-b8c1-9e81499f2275-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-62a4ca5e-3541-4a73-b8c1-9e81499f2275-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-quobyte-62a4ca5e-3541-4a73-b8c1-9e81499f2275" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-62a4ca5e-3541-4a73-b8c1-9e81499f2275" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:48 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.811s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Deleted volume successfully.
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[46055d17-f36e-450e-a15b-33d7313a7467]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1cc8707a-9601-406e-882e-2aa1afa17b44 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-a8260e5a-084a-4377-9225-239b0e69d952-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:48 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275
Nov 06 08:27:48 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:49 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275" returned: 0 in 0.636s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:49 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275
Nov 06 08:27:49 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:49 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-62a4ca5e-3541-4a73-b8c1-9e81499f2275" returned: 0 in 0.405s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-62a4ca5e-3541-4a73-b8c1-9e81499f2275" released by "delete_volume" :: held 1.132s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created reservations ['e844a144-d699-44fc-b25b-692c1e874578', '7a405c77-d254-4396-9c7e-c9a3f736695b', '4fb81107-e915-4a85-ab0b-713d75bb2b02', '321b6e32-b298-43d4-8667-821dcef6d78d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:49 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:49 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:50 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.473s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Deleted volume successfully.
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3add879b-d722-4b2c-9ee2-ebfabd1fde1f tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-62a4ca5e-3541-4a73-b8c1-9e81499f2275-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-ef4f8e66-6279-4189-aa80-514f7a46105a-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-ef4f8e66-6279-4189-aa80-514f7a46105a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-quobyte-ef4f8e66-6279-4189-aa80-514f7a46105a" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-ef4f8e66-6279-4189-aa80-514f7a46105a" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d0890-a814-4d6e-9f65-217badc3066a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:51 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a
Nov 06 08:27:51 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:51 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a" returned: 0 in 0.668s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:51 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a
Nov 06 08:27:51 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:52 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ef4f8e66-6279-4189-aa80-514f7a46105a" returned: 0 in 0.507s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-ef4f8e66-6279-4189-aa80-514f7a46105a" released by "delete_volume" :: held 1.272s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created reservations ['6fa959ec-fa4a-4f95-b92e-e3b560a91040', 'bdac23b7-6012-4dda-a1e6-4680d7a26ed0', '495bb347-d2bc-4af9-8b62-cfd045cb8104', '351ead71-ad55-4d84-be3c-dc2e82e43f7f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:52 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:52 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:52 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.457s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Deleted volume successfully.
Nov 06 08:27:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e431b308-0f4f-465e-9f5d-27c888167d9b tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-ef4f8e66-6279-4189-aa80-514f7a46105a-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-90a285c0-dcd4-4532-8fe7-62e1234ba130-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-90a285c0-dcd4-4532-8fe7-62e1234ba130-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-quobyte-90a285c0-dcd4-4532-8fe7-62e1234ba130" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-90a285c0-dcd4-4532-8fe7-62e1234ba130" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[867974cd-36e3-4314-9176-fd7e48260e5f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:53 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130
Nov 06 08:27:53 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:54 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130" returned: 0 in 0.598s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:54 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130
Nov 06 08:27:54 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:54 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90a285c0-dcd4-4532-8fe7-62e1234ba130" returned: 0 in 0.367s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-90a285c0-dcd4-4532-8fe7-62e1234ba130" released by "delete_volume" :: held 1.070s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created reservations ['2c82daed-a4c2-4447-a49b-e47f76dd38ea', 'cd877840-72a2-4c42-9f25-05ccfaec051a', '2ba2c4a9-34e7-41ac-a295-5044edf22393', '66c6e62e-f114-4949-a467-2adcad052df1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:54 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:54 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:54 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.314s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Deleted volume successfully.
Nov 06 08:27:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-47bab270-6155-49e0-8adf-88d02f6e0484 tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-90a285c0-dcd4-4532-8fe7-62e1234ba130-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-a5feec3b-cd9e-4295-8997-61319dfd5280-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-a5feec3b-cd9e-4295-8997-61319dfd5280-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "cinder-quobyte-a5feec3b-cd9e-4295-8997-61319dfd5280" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:27:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-a5feec3b-cd9e-4295-8997-61319dfd5280" acquired by "delete_volume" :: waited 0.046s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:27:55 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf59ffd-c440-4c3c-abf6-ad1d5c7c5180]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:27:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:56 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280
Nov 06 08:27:56 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:56 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280" returned: 0 in 0.767s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:56 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280
Nov 06 08:27:56 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:56 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a5feec3b-cd9e-4295-8997-61319dfd5280" returned: 0 in 0.389s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-quobyte-a5feec3b-cd9e-4295-8997-61319dfd5280" released by "delete_volume" :: held 1.232s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Created reservations ['88b65e54-7653-496f-b8c0-c2754ac9c6c0', '64aa54cd-ecbe-4c96-ac12-5773ab998c59', '495b6845-8250-4034-9ee6-f4dc762bdc15', 'ebda068b-ec12-449b-bdeb-157c79505c6e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:27:57 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:27:57 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:27:57 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.286s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:27:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Deleted volume successfully.
Nov 06 08:27:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-afe3b82c-9c0d-48dd-a8f9-d8b10147a6db tempest-CreateVolumesFromSourceVolumeTest-181742404 None] Lock "cinder-a5feec3b-cd9e-4295-8997-61319dfd5280-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:07 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=40,cinder:INSERT=15,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:28:07 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=59,cinder:DELETE=6,cinder:SELECT=38,cinder:INSERT=12 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (ede65429-143d-4f9d-9acd-7da3e1a1ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146af6bc-3036-4034-aa38-1c355502dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146af6bc-3036-4034-aa38-1c355502dbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739183486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb165d60-1137-4fbd-95ee-02616d0aee15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:11Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcabc48-20ff-4b45-8859-0cbc12667bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcabc48-20ff-4b45-8859-0cbc12667bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784c74ae-25e4-4094-9ece-b7ead253469d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784c74ae-25e4-4094-9ece-b7ead253469d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb165d60-1137-4fbd-95ee-02616d0aee15', 'volume_name': 'volume-eb165d60-1137-4fbd-95ee-02616d0aee15', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df146ae-2535-4b00-9aee-e24d05c8fe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df146ae-2535-4b00-9aee-e24d05c8fe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74b23a9-9161-4f17-93b6-b929e245423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:11 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Volume eb165d60-1137-4fbd-95ee-02616d0aee15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb165d60-1137-4fbd-95ee-02616d0aee15', 'volume_size': 1}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739183486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb165d60-1137-4fbd-95ee-02616d0aee15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:11Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Creating volume eb165d60-1137-4fbd-95ee-02616d0aee15 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:28:11 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:11 devstack sudo[100062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15 1073741824
Nov 06 08:28:11 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:11 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15 1073741824" returned: 0 in 0.546s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:11 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15
Nov 06 08:28:11 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:12 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15" returned: 0 in 0.279s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74b23a9-9161-4f17-93b6-b929e245423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb165d60-1137-4fbd-95ee-02616d0aee15', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16786dc5-dd8c-44a5-b5c8-647d47cec4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Volume volume-eb165d60-1137-4fbd-95ee-02616d0aee15 (eb165d60-1137-4fbd-95ee-02616d0aee15): created successfully
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16786dc5-dd8c-44a5-b5c8-647d47cec4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (ede65429-143d-4f9d-9acd-7da3e1a1ab98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5f8dddf4-4e13-46e2-bd96-643dd48ba1c6 tempest-ProjectReaderTests-649704012 None] Created volume successfully.
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Flow 'volume_create_manager' (f5e06a9a-41f2-42c5-a09d-03c347f24d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1dc547-90e3-4539-967a-dd9d22df4354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1dc547-90e3-4539-967a-dd9d22df4354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1233097160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac8c234-35f2-4eed-98fc-7ef569689b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439bb67faae34f82af141eb3940afcde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:12Z,use_quota=True,user_id='590393c3df444bac9fcdfaeb1f140440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ed23a-16ea-4ac6-a5ac-833c8ed7f98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ed23a-16ea-4ac6-a5ac-833c8ed7f98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c3c968-f43e-4dcb-bd33-4510371fe3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c3c968-f43e-4dcb-bd33-4510371fe3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac8c234-35f2-4eed-98fc-7ef569689b00', 'volume_name': 'volume-3ac8c234-35f2-4eed-98fc-7ef569689b00', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb751335-fdaf-4c4c-8243-2b37d164eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb751335-fdaf-4c4c-8243-2b37d164eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a5439e-548f-4767-8a16-08830dd9d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Volume 3ac8c234-35f2-4eed-98fc-7ef569689b00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac8c234-35f2-4eed-98fc-7ef569689b00', 'volume_size': 1}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1233097160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac8c234-35f2-4eed-98fc-7ef569689b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439bb67faae34f82af141eb3940afcde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:12Z,use_quota=True,user_id='590393c3df444bac9fcdfaeb1f140440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Creating volume 3ac8c234-35f2-4eed-98fc-7ef569689b00 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:28:12 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:28:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:12 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 1073741824
Nov 06 08:28:12 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:13 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 1073741824" returned: 0 in 0.454s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:13 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00
Nov 06 08:28:13 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:13 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00" returned: 0 in 0.303s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a5439e-548f-4767-8a16-08830dd9d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac8c234-35f2-4eed-98fc-7ef569689b00', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298fcf84-5890-4979-82cd-4c8984b926ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:13 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Volume volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 (3ac8c234-35f2-4eed-98fc-7ef569689b00): created successfully
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298fcf84-5890-4979-82cd-4c8984b926ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Flow 'volume_create_manager' (f5e06a9a-41f2-42c5-a09d-03c347f24d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:13 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e80f465c-8d1c-4d0d-a6da-75c7585a3df6 tempest-TestImageHashVerification-990091429 None] Created volume successfully.
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-eb165d60-1137-4fbd-95ee-02616d0aee15-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Lock "cinder-eb165d60-1137-4fbd-95ee-02616d0aee15-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-quobyte-eb165d60-1137-4fbd-95ee-02616d0aee15" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-eb165d60-1137-4fbd-95ee-02616d0aee15" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[222fb2d4-41ec-4259-87c8-5f065ca258a7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:13 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15
Nov 06 08:28:13 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:14 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15" returned: 0 in 0.426s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:14 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15
Nov 06 08:28:14 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:14 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb165d60-1137-4fbd-95ee-02616d0aee15" returned: 0 in 0.280s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-eb165d60-1137-4fbd-95ee-02616d0aee15" released by "delete_volume" :: held 0.754s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Created reservations ['bb919db2-2a93-4a43-80d4-4cf20070939c', '7bc97ae7-7a62-4bcb-bb77-792eb699d4de', '0334c209-ffdf-428b-8b5c-e46090622091', '01942b3c-341f-4413-a970-c1017d66d39a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:14 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:28:14 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:14 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.441s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:14 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:28:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Deleted volume successfully.
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-def26fc1-1e93-4308-aa98-6877f8e5d64a tempest-ProjectReaderTests-649704012 None] Lock "cinder-eb165d60-1137-4fbd-95ee-02616d0aee15-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (23c0ab7c-4b07-43c2-8379-36342b20efe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f41bea0-4119-4df3-8c72-17f527365f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f41bea0-4119-4df3-8c72-17f527365f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700092844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:16Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2042c7-7803-4863-ae76-771b93ff4ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2042c7-7803-4863-ae76-771b93ff4ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638174ee-dab4-40dd-adbd-d63a60f22bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638174ee-dab4-40dd-adbd-d63a60f22bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d', 'volume_name': 'volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd367d7-32b9-41b3-8a51-6b94b570467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd367d7-32b9-41b3-8a51-6b94b570467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da4ae06-37e8-41e5-9ab5-c7a7bf74a63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Volume 81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d', 'volume_size': 1}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700092844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:16Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Creating volume 81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:28:15 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:28:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:15 devstack sudo[100117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d 1073741824
Nov 06 08:28:15 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:16 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d 1073741824" returned: 0 in 0.873s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:16 devstack sudo[100127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d
Nov 06 08:28:16 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:16 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d" returned: 0 in 0.266s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.374s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da4ae06-37e8-41e5-9ab5-c7a7bf74a63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb971fa6-a899-433b-99ac-2974c1de01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9878de71-01a8-4263-afab-d25b32949bea]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Volume volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d (81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d): created successfully
Nov 06 08:28:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb971fa6-a899-433b-99ac-2974c1de01f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (23c0ab7c-4b07-43c2-8379-36342b20efe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6bf7b443-4a35-4f4a-964a-1f0ea0d29e0e tempest-ProjectReaderTests-649704012 None] Created volume successfully.
Nov 06 08:28:17 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00
Nov 06 08:28:17 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:17 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00" returned: 0 in 0.395s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[827de9bf-9ae9-49b6-b29a-70e3d9de5402]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:17 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00
Nov 06 08:28:17 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:17 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00" returned: 0 in 0.524s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 /opt/stack/data/cinder/conversion/3ac8c234-35f2-4eed-98fc-7ef569689b00.temp_image.6c659b41-3def-475f-9dea-46f59cbf24086obbvg4i.img {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Lock "cinder-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:17 devstack sudo[100143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 /opt/stack/data/cinder/conversion/3ac8c234-35f2-4eed-98fc-7ef569689b00.temp_image.6c659b41-3def-475f-9dea-46f59cbf24086obbvg4i.img
Nov 06 08:28:17 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-quobyte-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d" acquired by "delete_volume" :: waited 0.046s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fd2ba5-0413-4076-9e6e-ac1402b99150]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:18 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d
Nov 06 08:28:18 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:19 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d" returned: 0 in 1.597s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:19 devstack sudo[100229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d
Nov 06 08:28:19 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:20 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d" returned: 0 in 1.049s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d" released by "delete_volume" :: held 2.792s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:21 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Created reservations ['9e8d311e-0e4f-4eb2-bd54-c5088726054c', '67df00b5-d824-456f-8e0c-14cf2cb1a31b', '1b588f8b-59bb-413a-b2f8-5aa0394f50ce', 'cb5bd50f-d8b7-4500-952f-0073ffc36bdc'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:28:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:21 devstack sudo[100249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:28:21 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:22 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.786s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:22 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:28:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Deleted volume successfully.
Nov 06 08:28:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3465768e-62b1-494a-a16a-cdc37064abec tempest-ProjectReaderTests-649704012 None] Lock "cinder-81c3c7c7-f073-4b10-8a55-8f6cc7fe9d1d-delete_volume" released by "delete_volume" :: held 4.577s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (7ad3b9c3-47ea-4abb-874f-9afd84b446bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3760735f-79fb-478e-b5e8-7326195ebbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3760735f-79fb-478e-b5e8-7326195ebbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665993113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24799c67-b8f0-4372-86dd-8f2080782f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:24Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1c050b-cfaa-4f2d-8fe1-87563afa17ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1c050b-cfaa-4f2d-8fe1-87563afa17ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c46c59-426b-47b7-9e06-cb305f85a7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c46c59-426b-47b7-9e06-cb305f85a7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24799c67-b8f0-4372-86dd-8f2080782f49', 'volume_name': 'volume-24799c67-b8f0-4372-86dd-8f2080782f49', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41e8f3a-5d05-4635-a328-89cc23ecfcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41e8f3a-5d05-4635-a328-89cc23ecfcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61d7ccb-c02e-4978-a51f-e14a657908a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Volume 24799c67-b8f0-4372-86dd-8f2080782f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24799c67-b8f0-4372-86dd-8f2080782f49', 'volume_size': 1}
Nov 06 08:28:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-757d18b5-1bb0-443c-9319-e71a841c38a8 req-33aef61e-3420-4e4e-94da-fadf8b332e2f tempest-TestShelveInstance-629874385 None] Terminate volume connection completed successfully.
Nov 06 08:28:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-757d18b5-1bb0-443c-9319-e71a841c38a8 req-33aef61e-3420-4e4e-94da-fadf8b332e2f tempest-TestShelveInstance-629874385 None] Deleting attachment 311b3604-115d-47ec-8b5f-27d790c46e5a. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:28:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:28:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:30 devstack sudo[100279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:28:30 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:31 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 /opt/stack/data/cinder/conversion/3ac8c234-35f2-4eed-98fc-7ef569689b00.temp_image.6c659b41-3def-475f-9dea-46f59cbf24086obbvg4i.img" returned: 0 in 13.207s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdbfc8a-041c-413a-b8a8-e2a498760215]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:31 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.708s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:28:31 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00
Nov 06 08:28:31 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:31 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00" returned: 0 in 0.692s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00, size 1024.00 MB, duration 13.21 sec, destination /opt/stack/data/cinder/conversion/3ac8c234-35f2-4eed-98fc-7ef569689b00.temp_image.6c659b41-3def-475f-9dea-46f59cbf24086obbvg4i.img {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:28:31 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Converted 1024.00 MB image at 77.51 MB/s
Nov 06 08:28:31 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] 6c659b41-3def-475f-9dea-46f59cbf2408 was raw, no need to convert to raw {{(pid=87143) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 06 08:28:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-121e1f97-fe46-47da-a301-5ee925da0ac4 req-991ccc85-a691-4c67-ba6c-f5f9e7ba7142 tempest-TestShelveInstance-629874385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:41 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=29,cinder:SELECT=16,cinder:INSERT=2,cinder:DELETE=4 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:28:42 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Flow 'volume_create_manager' (e774a7df-5940-4541-b26d-b6f49894e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e28cb4-fb21-4b6c-afac-7f665f46f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e28cb4-fb21-4b6c-afac-7f665f46f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1002673728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348d6108-c5ac-4f84-8fd7-66326452bb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85e86d84d154551979c543f4370dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:43Z,use_quota=True,user_id='ff3789fde1364c019abf06ae4df29693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907446c7-b247-4246-aa0e-2d0bcd4b9e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907446c7-b247-4246-aa0e-2d0bcd4b9e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3471b52d-67fb-47fc-9350-202c75d11bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3471b52d-67fb-47fc-9350-202c75d11bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348d6108-c5ac-4f84-8fd7-66326452bb9c', 'volume_name': 'volume-348d6108-c5ac-4f84-8fd7-66326452bb9c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fe6304-2daf-43ea-80b2-890bc3cffee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fe6304-2daf-43ea-80b2-890bc3cffee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898fa206-abdb-4d11-97ee-73805ca6c93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:43 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Volume 348d6108-c5ac-4f84-8fd7-66326452bb9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348d6108-c5ac-4f84-8fd7-66326452bb9c', 'volume_size': 1}
Nov 06 08:28:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.857s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Uploaded volume to glance image-id: 6c659b41-3def-475f-9dea-46f59cbf2408. {{(pid=87143) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.871s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665993113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24799c67-b8f0-4372-86dd-8f2080782f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:24Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Creating volume 24799c67-b8f0-4372-86dd-8f2080782f49 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:28:51 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:28:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:51 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49 1073741824
Nov 06 08:28:51 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:51 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b8f3d5d8-b62e-453b-9e99-31979895f939 tempest-TestImageHashVerification-990091429 None] Copy volume to image completed successfully.
Nov 06 08:28:52 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49 1073741824" returned: 0 in 0.455s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:52 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49
Nov 06 08:28:52 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:52 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-121e1f97-fe46-47da-a301-5ee925da0ac4 req-991ccc85-a691-4c67-ba6c-f5f9e7ba7142 tempest-TestShelveInstance-629874385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 20.411s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-121e1f97-fe46-47da-a301-5ee925da0ac4 req-991ccc85-a691-4c67-ba6c-f5f9e7ba7142 tempest-TestShelveInstance-629874385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.056s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1002673728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348d6108-c5ac-4f84-8fd7-66326452bb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85e86d84d154551979c543f4370dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:43Z,use_quota=True,user_id='ff3789fde1364c019abf06ae4df29693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Creating volume 348d6108-c5ac-4f84-8fd7-66326452bb9c {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:28:52 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61d7ccb-c02e-4978-a51f-e14a657908a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24799c67-b8f0-4372-86dd-8f2080782f49', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5d2cf5-43f0-491b-ae5e-fcf7543dbc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:52 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c 1073741824
Nov 06 08:28:52 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:52 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Volume volume-24799c67-b8f0-4372-86dd-8f2080782f49 (24799c67-b8f0-4372-86dd-8f2080782f49): created successfully
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5d2cf5-43f0-491b-ae5e-fcf7543dbc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (7ad3b9c3-47ea-4abb-874f-9afd84b446bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-121e1f97-fe46-47da-a301-5ee925da0ac4 req-991ccc85-a691-4c67-ba6c-f5f9e7ba7142 tempest-TestShelveInstance-629874385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a241c99-08c8-449c-9555-b3bee80df47d', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:28:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fcbcbb1c-409d-4e0c-9b8c-627445bb02ae tempest-ProjectReaderTests-649704012 None] Created volume successfully.
Nov 06 08:28:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-121e1f97-fe46-47da-a301-5ee925da0ac4 req-991ccc85-a691-4c67-ba6c-f5f9e7ba7142 tempest-TestShelveInstance-629874385 None] attachment_update completed successfully.
Nov 06 08:28:53 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c 1073741824" returned: 0 in 0.613s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:53 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c
Nov 06 08:28:53 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Acquiring lock "cinder-3ac8c234-35f2-4eed-98fc-7ef569689b00-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Lock "cinder-3ac8c234-35f2-4eed-98fc-7ef569689b00-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Acquiring lock "cinder-quobyte-3ac8c234-35f2-4eed-98fc-7ef569689b00" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Lock "cinder-quobyte-3ac8c234-35f2-4eed-98fc-7ef569689b00" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-24799c67-b8f0-4372-86dd-8f2080782f49-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[43037f1e-a9e9-4216-bf57-cff6d122d51c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Lock "cinder-24799c67-b8f0-4372-86dd-8f2080782f49-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:53 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-quobyte-24799c67-b8f0-4372-86dd-8f2080782f49" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c" returned: 0 in 0.412s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-24799c67-b8f0-4372-86dd-8f2080782f49" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898fa206-abdb-4d11-97ee-73805ca6c93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348d6108-c5ac-4f84-8fd7-66326452bb9c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8e65e5-fda1-47a7-86c5-c3eb1ef7a9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4db9489-453a-4eb6-ba16-5ef180910e2c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:53 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Volume volume-348d6108-c5ac-4f84-8fd7-66326452bb9c (348d6108-c5ac-4f84-8fd7-66326452bb9c): created successfully
Nov 06 08:28:53 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00
Nov 06 08:28:53 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8e65e5-fda1-47a7-86c5-c3eb1ef7a9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Flow 'volume_create_manager' (e774a7df-5940-4541-b26d-b6f49894e629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:53 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c6faba47-2803-4ef3-993d-56d3b42b6b25 tempest-AttachVolumeTestJSON-954746583 None] Created volume successfully.
Nov 06 08:28:53 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49
Nov 06 08:28:53 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:54 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00" returned: 0 in 0.448s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:54 devstack sudo[100345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00
Nov 06 08:28:54 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:54 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49" returned: 0 in 0.513s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:54 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49
Nov 06 08:28:54 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:54 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3ac8c234-35f2-4eed-98fc-7ef569689b00" returned: 0 in 0.375s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Lock "cinder-quobyte-3ac8c234-35f2-4eed-98fc-7ef569689b00" released by "delete_volume" :: held 0.900s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Created reservations ['4d4a1836-248c-47ce-b4ae-6e95081761be', '1b947f9f-ad57-48eb-9e2d-be2a45098266', '8cef66d7-d7d8-40c2-9a42-2302e79e54b8', '28ddf8dc-c060-4d0f-9c5e-34e61ca894d5'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:28:54 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-24799c67-b8f0-4372-86dd-8f2080782f49" returned: 0 in 0.389s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-24799c67-b8f0-4372-86dd-8f2080782f49" released by "delete_volume" :: held 0.981s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:54 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:28:54 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Created reservations ['32f8cde5-7a5d-4e1e-84a3-07069412642e', 'c161f24a-8032-44c2-8f73-888dc90810a6', '181b5515-e1a5-4161-b71e-d2c8b918e7d3', '29b9c110-b096-4eb2-b0ab-cf67e70bda58'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:55 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:28:55 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:55 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.422s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:28:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Deleted volume successfully.
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-d10aadd4-566a-4ae0-b469-653dff2ef30e req-ee863416-10c5-4519-b4c5-6c48144ec881 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-d10aadd4-566a-4ae0-b469-653dff2ef30e req-ee863416-10c5-4519-b4c5-6c48144ec881 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bbe28353-74ca-4d85-ab14-b6a7b1505fa8 tempest-TestImageHashVerification-990091429 None] Lock "cinder-3ac8c234-35f2-4eed-98fc-7ef569689b00-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-d10aadd4-566a-4ae0-b469-653dff2ef30e req-ee863416-10c5-4519-b4c5-6c48144ec881 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-d10aadd4-566a-4ae0-b469-653dff2ef30e req-ee863416-10c5-4519-b4c5-6c48144ec881 tempest-AttachVolumeTestJSON-954746583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-348d6108-c5ac-4f84-8fd7-66326452bb9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f8b797d-6b91-4fc5-9dee-62e55ea40b06', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:28:55 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.321s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:28:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Deleted volume successfully.
Nov 06 08:28:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-d10aadd4-566a-4ae0-b469-653dff2ef30e req-ee863416-10c5-4519-b4c5-6c48144ec881 tempest-AttachVolumeTestJSON-954746583 None] attachment_update completed successfully.
Nov 06 08:28:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5c76517c-e8b9-4bff-83d2-0c4413d73533 tempest-ProjectReaderTests-649704012 None] Lock "cinder-24799c67-b8f0-4372-86dd-8f2080782f49-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (a0b8cadf-a618-46b4-b98a-a987aa2e9795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945d39e5-2cf0-44bd-8ef1-e0f6c3dc0695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945d39e5-2cf0-44bd-8ef1-e0f6c3dc0695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-179151079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c030cb44-6bc3-4ece-af60-cab7ecbb9f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:57Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1210556-1dad-405a-8f68-97f4d2bb777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1210556-1dad-405a-8f68-97f4d2bb777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72307e10-8df4-464f-bac9-a0d38894c58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72307e10-8df4-464f-bac9-a0d38894c58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c030cb44-6bc3-4ece-af60-cab7ecbb9f0d', 'volume_name': 'volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab65720-582d-4821-bd0b-4cc6be8ba23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab65720-582d-4821-bd0b-4cc6be8ba23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc26d489-1ce5-46b4-944a-d09df7c5ca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:57 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Volume c030cb44-6bc3-4ece-af60-cab7ecbb9f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d', 'volume_size': 1}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-179151079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c030cb44-6bc3-4ece-af60-cab7ecbb9f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78c2fe0645543faa8e50b567533c087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:57Z,use_quota=True,user_id='90b7e214e5564265ae9834187becfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Creating volume c030cb44-6bc3-4ece-af60-cab7ecbb9f0d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:28:57 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:57 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d 1073741824
Nov 06 08:28:57 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:57 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d 1073741824" returned: 0 in 0.795s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:58 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d
Nov 06 08:28:58 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Flow 'volume_create_manager' (98ee8898-167b-40ce-a1ba-7edcebc84c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867887d3-c0de-4fbd-9f78-593d4f740af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867887d3-c0de-4fbd-9f78-593d4f740af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1091177375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96925f16-baa0-4348-8f06-aac48b063e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85e86d84d154551979c543f4370dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:59Z,use_quota=True,user_id='ff3789fde1364c019abf06ae4df29693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:58 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63a9c3a-9fd7-418c-ac97-5aec5671a0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63a9c3a-9fd7-418c-ac97-5aec5671a0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30b1cc0-3787-4a10-9eb8-e320a91e0324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30b1cc0-3787-4a10-9eb8-e320a91e0324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96925f16-baa0-4348-8f06-aac48b063e21', 'volume_name': 'volume-96925f16-baa0-4348-8f06-aac48b063e21', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8300ae45-a465-43f7-ad11-8b8ffd6c0da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8300ae45-a465-43f7-ad11-8b8ffd6c0da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06169be4-7374-4f79-88c9-535289a4a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:58 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Volume 96925f16-baa0-4348-8f06-aac48b063e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96925f16-baa0-4348-8f06-aac48b063e21', 'volume_size': 1}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d" returned: 0 in 0.684s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1091177375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96925f16-baa0-4348-8f06-aac48b063e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85e86d84d154551979c543f4370dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:28:59Z,use_quota=True,user_id='ff3789fde1364c019abf06ae4df29693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Creating volume 96925f16-baa0-4348-8f06-aac48b063e21 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:28:58 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:58 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21 1073741824
Nov 06 08:28:58 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc26d489-1ce5-46b4-944a-d09df7c5ca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c27b65-e576-4715-9c8c-aa4d148caa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:28:58 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Volume volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d (c030cb44-6bc3-4ece-af60-cab7ecbb9f0d): created successfully
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c27b65-e576-4715-9c8c-aa4d148caa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:28:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Flow 'volume_create_manager' (a0b8cadf-a618-46b4-b98a-a987aa2e9795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:28:58 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-750f9657-9e81-4588-9e83-75afae954724 tempest-ProjectReaderTests-649704012 None] Created volume successfully.
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Lock "cinder-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Acquiring lock "cinder-quobyte-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d" acquired by "delete_volume" :: waited 0.075s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72c3ccc-1570-4c81-804c-804106756db9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:59 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d
Nov 06 08:28:59 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:28:59 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21 1073741824" returned: 0 in 0.956s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:28:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:28:59 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21
Nov 06 08:28:59 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:00 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d" returned: 0 in 0.657s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:00 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d
Nov 06 08:29:00 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:00 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21" returned: 0 in 0.396s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06169be4-7374-4f79-88c9-535289a4a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96925f16-baa0-4348-8f06-aac48b063e21', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2b3cf4-26a2-4c0d-9a4b-f91a92106dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:00 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Volume volume-96925f16-baa0-4348-8f06-aac48b063e21 (96925f16-baa0-4348-8f06-aac48b063e21): created successfully
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2b3cf4-26a2-4c0d-9a4b-f91a92106dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Flow 'volume_create_manager' (98ee8898-167b-40ce-a1ba-7edcebc84c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:29:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b6cef6f5-b0aa-41d5-ade6-58b0663fff3a tempest-AttachVolumeTestJSON-954746583 None] Created volume successfully.
Nov 06 08:29:00 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d" returned: 0 in 0.390s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Lock "cinder-quobyte-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d" released by "delete_volume" :: held 1.150s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Created reservations ['a090a541-00b7-49ea-80e9-389d1da85b77', 'ed5db959-79cb-4200-a3d8-2ae78b74415b', '0e53c502-fe25-42df-a01a-325f58779852', '1d5548d9-de96-4116-b946-f9364f48156a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:00 devstack sudo[100885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:00 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:00 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:00 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Deleted volume successfully.
Nov 06 08:29:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d1011e2e-1cc7-4523-895a-2a5b83dd4b84 tempest-ProjectReaderTests-649704012 None] Lock "cinder-c030cb44-6bc3-4ece-af60-cab7ecbb9f0d-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-e764a3b6-5643-4c2b-ae8c-31fb98d50633 req-f89c0116-4d70-4c92-bf6d-f4f3a5b0ddfe tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-e764a3b6-5643-4c2b-ae8c-31fb98d50633 req-f89c0116-4d70-4c92-bf6d-f4f3a5b0ddfe tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-e764a3b6-5643-4c2b-ae8c-31fb98d50633 req-f89c0116-4d70-4c92-bf6d-f4f3a5b0ddfe tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-e764a3b6-5643-4c2b-ae8c-31fb98d50633 req-f89c0116-4d70-4c92-bf6d-f4f3a5b0ddfe tempest-AttachVolumeTestJSON-954746583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-96925f16-baa0-4348-8f06-aac48b063e21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '380587e6-ee76-413c-a81f-0fe4b651baf4', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:29:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-e764a3b6-5643-4c2b-ae8c-31fb98d50633 req-f89c0116-4d70-4c92-bf6d-f4f3a5b0ddfe tempest-AttachVolumeTestJSON-954746583 None] attachment_update completed successfully.
Nov 06 08:29:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-92debfaa-d648-4e2e-afaa-5ade2d099605 req-f2ac3b46-9e92-41f6-8a25-f779a704a76b tempest-AttachVolumeTestJSON-954746583 None] Terminate volume connection completed successfully.
Nov 06 08:29:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-92debfaa-d648-4e2e-afaa-5ade2d099605 req-f2ac3b46-9e92-41f6-8a25-f779a704a76b tempest-AttachVolumeTestJSON-954746583 None] Deleting attachment 3f8b797d-6b91-4fc5-9dee-62e55ea40b06. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:29:06 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-e9b5d065-da12-4c26-9d4a-8af7fa632e73 req-4ae11d52-87f4-40ab-b085-55a843c62a90 tempest-AttachVolumeTestJSON-954746583 None] Terminate volume connection completed successfully.
Nov 06 08:29:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-e9b5d065-da12-4c26-9d4a-8af7fa632e73 req-4ae11d52-87f4-40ab-b085-55a843c62a90 tempest-AttachVolumeTestJSON-954746583 None] Deleting attachment 380587e6-ee76-413c-a81f-0fe4b651baf4. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "cinder-96925f16-baa0-4348-8f06-aac48b063e21-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-96925f16-baa0-4348-8f06-aac48b063e21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "cinder-quobyte-96925f16-baa0-4348-8f06-aac48b063e21" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-quobyte-96925f16-baa0-4348-8f06-aac48b063e21" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d01ea-2a51-482f-bd1e-5dea2d0d2a01]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:13 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21
Nov 06 08:29:13 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Flow 'volume_create_manager' (5f0dc9bc-ee7d-4dc5-84e6-448412e9d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2341c7-f7a3-4a4b-b3f2-d9300bffe687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2341c7-f7a3-4a4b-b3f2-d9300bffe687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620a590a-c50c-49bb-aa03-ce68d46df33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86262314682147feb8a7e714d997fa0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:29:14Z,use_quota=True,user_id='bc28ac8c2c004bc8a27f7594be673f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1720f04a-103a-44ad-8e1c-f2b36cf24b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1720f04a-103a-44ad-8e1c-f2b36cf24b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6a348c-fd40-4678-9dc3-5a3add0f2599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6a348c-fd40-4678-9dc3-5a3add0f2599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620a590a-c50c-49bb-aa03-ce68d46df33f', 'volume_name': 'volume-620a590a-c50c-49bb-aa03-ce68d46df33f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccebf7e-b44c-47b5-89c6-cfd7fd7d2db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccebf7e-b44c-47b5-89c6-cfd7fd7d2db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae26ecd-f155-49aa-97af-9d98fe093732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Volume 620a590a-c50c-49bb-aa03-ce68d46df33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620a590a-c50c-49bb-aa03-ce68d46df33f', 'volume_size': 1}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620a590a-c50c-49bb-aa03-ce68d46df33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86262314682147feb8a7e714d997fa0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:29:14Z,use_quota=True,user_id='bc28ac8c2c004bc8a27f7594be673f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Creating volume 620a590a-c50c-49bb-aa03-ce68d46df33f {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:29:14 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:14 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f 1073741824
Nov 06 08:29:14 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:14 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21" returned: 0 in 0.531s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:14 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21
Nov 06 08:29:14 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:14 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-96925f16-baa0-4348-8f06-aac48b063e21" returned: 0 in 0.318s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-quobyte-96925f16-baa0-4348-8f06-aac48b063e21" released by "delete_volume" :: held 0.912s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Created reservations ['f768f4c8-3113-45ac-a99f-7523cb6194a6', '0a1ee097-445d-4bde-bc6c-035533b8480c', 'a41518d5-78b3-47c0-860c-9712d96c006c', '272575ba-615c-4905-b39a-2b3dd3dfe1c7'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:14 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f 1073741824" returned: 0 in 0.540s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:14 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f
Nov 06 08:29:14 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:14 devstack sudo[101001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:14 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "cinder-348d6108-c5ac-4f84-8fd7-66326452bb9c-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-348d6108-c5ac-4f84-8fd7-66326452bb9c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "cinder-quobyte-348d6108-c5ac-4f84-8fd7-66326452bb9c" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-quobyte-348d6108-c5ac-4f84-8fd7-66326452bb9c" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69e3039-aec3-4d2f-a19d-2b0092c35c73]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:14 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.326s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Deleted volume successfully.
Nov 06 08:29:15 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f" returned: 0 in 0.385s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae26ecd-f155-49aa-97af-9d98fe093732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620a590a-c50c-49bb-aa03-ce68d46df33f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77947d79-7980-4233-8b99-524ce4b75011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d62e6ccb-510b-4a50-a31c-53a386e01342 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-96925f16-baa0-4348-8f06-aac48b063e21-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:15 devstack sudo[101004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c
Nov 06 08:29:15 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Volume volume-620a590a-c50c-49bb-aa03-ce68d46df33f (620a590a-c50c-49bb-aa03-ce68d46df33f): created successfully
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77947d79-7980-4233-8b99-524ce4b75011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Flow 'volume_create_manager' (5f0dc9bc-ee7d-4dc5-84e6-448412e9d300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:29:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5617a350-9178-4698-947c-66b918bc54a9 tempest-CinderUnicodeTest-2040232578 None] Created volume successfully.
Nov 06 08:29:15 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c" returned: 0 in 0.386s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:15 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c
Nov 06 08:29:15 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:15 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-348d6108-c5ac-4f84-8fd7-66326452bb9c" returned: 0 in 0.252s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-quobyte-348d6108-c5ac-4f84-8fd7-66326452bb9c" released by "delete_volume" :: held 0.712s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Created reservations ['ef7d728a-0ab1-4d4b-b36b-87bb134328df', '0e92ad29-44e3-4f85-b819-54b6f610155a', '651e3be5-2b83-438b-b848-4559a641a97d', 'a6475bb6-b62a-448e-889f-f6630d09783d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:15 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:15 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:15 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.251s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:15 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Deleted volume successfully.
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fdd2b0da-1f88-4994-b96f-04db83d44098 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-348d6108-c5ac-4f84-8fd7-66326452bb9c-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "cinder-355fa877-2ba3-47dd-85c7-4c3e367a8c5e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-355fa877-2ba3-47dd-85c7-4c3e367a8c5e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "cinder-quobyte-355fa877-2ba3-47dd-85c7-4c3e367a8c5e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-quobyte-355fa877-2ba3-47dd-85c7-4c3e367a8c5e" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[934f3bfc-2f55-40ef-a3c7-0312746519ea]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:16 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e
Nov 06 08:29:16 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:16 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e" returned: 0 in 0.398s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:16 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e
Nov 06 08:29:16 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Flow 'volume_create_manager' (1fc95fc7-e25f-4b97-88dc-9be3230cf5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3938242d-1bc3-478b-806b-409d5d7add5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3938242d-1bc3-478b-806b-409d5d7add5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:29:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-618002551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d69b9e9-e625-458c-8e90-089e3f5e1ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86262314682147feb8a7e714d997fa0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:29:17Z,use_quota=True,user_id='bc28ac8c2c004bc8a27f7594be673f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ccbb8c-fcfa-4a14-b2ef-04b6579d6ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ccbb8c-fcfa-4a14-b2ef-04b6579d6ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf6ca35-3211-4ae3-b360-e94e6e9c1ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf6ca35-3211-4ae3-b360-e94e6e9c1ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d69b9e9-e625-458c-8e90-089e3f5e1ac0', 'volume_name': 'volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcfde2d-eef5-4f43-b950-b20f548dd704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcfde2d-eef5-4f43-b950-b20f548dd704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088bb880-264c-4c85-93bb-c92beae8f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Volume 6d69b9e9-e625-458c-8e90-089e3f5e1ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0', 'volume_size': 1}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:29:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-618002551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d69b9e9-e625-458c-8e90-089e3f5e1ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86262314682147feb8a7e714d997fa0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:29:17Z,use_quota=True,user_id='bc28ac8c2c004bc8a27f7594be673f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Creating volume 6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:29:16 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:16 devstack sudo[101049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 1073741824
Nov 06 08:29:16 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:16 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-355fa877-2ba3-47dd-85c7-4c3e367a8c5e" returned: 0 in 0.265s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-quobyte-355fa877-2ba3-47dd-85c7-4c3e367a8c5e" released by "delete_volume" :: held 0.713s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Created reservations ['ed8ad645-fcc1-49d3-965c-ff3fec4a56b5', 'f7140a9f-2f2f-4ef2-8dc9-9d1c459ef684', 'dbaac146-c1f2-4bac-a0e1-33220ef53e12', 'a13d6be7-e735-4bf2-86e1-448e4318fa17'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:16 devstack sudo[101052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:16 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:17 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 1073741824" returned: 0 in 0.449s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:17 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.265s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Deleted volume successfully.
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1800b334-40ac-42e1-86a5-0060b2cc13f6 tempest-AttachVolumeTestJSON-954746583 None] Lock "cinder-355fa877-2ba3-47dd-85c7-4c3e367a8c5e-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:17 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0
Nov 06 08:29:17 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:17 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" returned: 0 in 0.251s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088bb880-264c-4c85-93bb-c92beae8f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6768de33-5a1b-4f28-968d-a5c05d998fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:17 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Volume volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 (6d69b9e9-e625-458c-8e90-089e3f5e1ac0): created successfully
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6768de33-5a1b-4f28-968d-a5c05d998fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Flow 'volume_create_manager' (1fc95fc7-e25f-4b97-88dc-9be3230cf5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:29:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f74db248-2dbb-4130-a99f-b85aed4e7b18 tempest-CinderUnicodeTest-2040232578 None] Created volume successfully.
Nov 06 08:29:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Creating offline snapshot e1d44f13-5c15-438b-bd07-16c6052e54cf of volume 6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:29:19 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d8846-b822-406b-aae9-b1dc0ee69030]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:19 devstack sudo[101062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0
Nov 06 08:29:19 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:19 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" returned: 0 in 0.377s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:19 devstack sudo[101067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf 1G
Nov 06 08:29:19 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:19 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf 1G" returned: 0 in 0.442s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:19 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf
Nov 06 08:29:19 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:20 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf" returned: 0 in 0.333s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:20 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf is being set with open permissions: ugo+rw
Nov 06 08:29:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:20 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf
Nov 06 08:29:20 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:20 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf" returned: 0 in 0.252s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:20 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.info
Nov 06 08:29:20 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:20 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.info" returned: 0 in 0.321s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:20 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.info is being set with open permissions: ugo+rw
Nov 06 08:29:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:20 devstack sudo[101086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.info
Nov 06 08:29:20 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:21 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.info" returned: 0 in 0.272s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:21 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d8fdc7bc-b630-4c9c-bca7-7c48d29ed0d5 tempest-CinderUnicodeTest-2040232578 None] Create snapshot completed successfully
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "cinder-e1d44f13-5c15-438b-bd07-16c6052e54cf-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-e1d44f13-5c15-438b-bd07-16c6052e54cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "cinder-quobyte-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "cinder-quobyte-e1d44f13-5c15-438b-bd07-16c6052e54cf" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-e1d44f13-5c15-438b-bd07-16c6052e54cf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Deleting offline snapshot e1d44f13-5c15-438b-bd07-16c6052e54cf of volume 6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] snapshot_file for this snap is: volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2138dc5e-025d-45dc-92ef-3e6a63b5b392]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:22 devstack sudo[101090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf
Nov 06 08:29:22 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:22 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf" returned: 0 in 0.424s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a1ba4a-3ae3-4a88-a94e-79016e3c6847]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:22 devstack sudo[101095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0
Nov 06 08:29:22 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:23 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" returned: 0 in 0.430s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:23 devstack sudo[101101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf
Nov 06 08:29:23 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:23 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf" returned: 0 in 0.401s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:23 devstack sudo[101107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf
Nov 06 08:29:23 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:23 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0.e1d44f13-5c15-438b-bd07-16c6052e54cf" returned: 0 in 0.304s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-e1d44f13-5c15-438b-bd07-16c6052e54cf" released by "_delete_snapshot" :: held 1.713s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" released by "delete_snapshot" :: held 1.740s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Created reservations ['6c1e9066-c95a-4bf2-8557-cc05543aa313', '6e9926f1-b51e-4d52-b1a2-94532944cf89', '4f8ba8a8-b2db-4513-841d-93e8ccdddc75', '7c905446-856c-43bb-905d-de6d6d411522'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:24 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Delete snapshot completed successfully.
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03bfcdf-f203-4b36-88d2-611d5f35b974 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-e1d44f13-5c15-438b-bd07-16c6052e54cf-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "cinder-6d69b9e9-e625-458c-8e90-089e3f5e1ac0-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-6d69b9e9-e625-458c-8e90-089e3f5e1ac0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "cinder-quobyte-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1727bbcd-e089-4a03-8c24-d9237d8486b4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:24 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0
Nov 06 08:29:24 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:24 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" returned: 0 in 0.405s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:24 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0
Nov 06 08:29:24 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:25 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" returned: 0 in 0.276s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-6d69b9e9-e625-458c-8e90-089e3f5e1ac0" released by "delete_volume" :: held 0.775s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Created reservations ['c92bb6f6-f8ec-4230-bdcd-ddd9ed2b5e99', '3ef33961-c7dd-4469-a62d-5883e1759da6', '02766b04-dd90-41a2-ad4d-15dc0c13566a', 'acc01265-bbb8-4d71-bf2c-f1de9eb21d77'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:25 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:25 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "cinder-620a590a-c50c-49bb-aa03-ce68d46df33f-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-620a590a-c50c-49bb-aa03-ce68d46df33f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "cinder-quobyte-620a590a-c50c-49bb-aa03-ce68d46df33f" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-620a590a-c50c-49bb-aa03-ce68d46df33f" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:25 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.290s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Deleted volume successfully.
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[43faf288-5531-4a07-b674-6d849d334242]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9dff3ca0-d5a4-43e1-82a8-93f078cb8107 tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-6d69b9e9-e625-458c-8e90-089e3f5e1ac0-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:25 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f
Nov 06 08:29:25 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:26 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f" returned: 0 in 0.379s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:26 devstack sudo[101126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f
Nov 06 08:29:26 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:26 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-620a590a-c50c-49bb-aa03-ce68d46df33f" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-quobyte-620a590a-c50c-49bb-aa03-ce68d46df33f" released by "delete_volume" :: held 0.690s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Created reservations ['508050a6-dbbc-4af8-9619-04bf4f6f155e', '9202e727-3228-4b10-baff-285f9d3c46af', '4c9203db-c2fc-40a1-b135-a207ec392d28', 'ad17e098-6434-43af-86ea-5cd7cfb44af3'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:26 devstack sudo[101129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:26 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:26 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.274s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Deleted volume successfully.
Nov 06 08:29:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f62235f2-63e4-466b-a006-096e42c88b6a tempest-CinderUnicodeTest-2040232578 None] Lock "cinder-620a590a-c50c-49bb-aa03-ce68d46df33f-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:30 devstack sudo[101133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:30 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:30 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.282s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:29:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:29:36 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=77,cinder:UPDATE=101,cinder:DELETE=8,cinder:INSERT=21 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:29:36 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=85,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:29:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-debad4ce-2879-4ce2-9e3b-81e3cb3ebe7d tempest-TestShelveInstance-629874385 None] Terminate volume connection completed successfully.
Nov 06 08:29:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-debad4ce-2879-4ce2-9e3b-81e3cb3ebe7d tempest-TestShelveInstance-629874385 None] Deleting attachment 8a241c99-08c8-449c-9555-b3bee80df47d. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:29:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Acquiring lock "cinder-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Lock "cinder-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Acquiring lock "cinder-quobyte-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:29:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Lock "cinder-quobyte-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce" acquired by "delete_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:29:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f54d19-e433-4c8c-9ab1-cdd9a40a66bd]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:29:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:40 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce
Nov 06 08:29:40 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:40 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce" returned: 0 in 0.540s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:40 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce
Nov 06 08:29:40 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:40 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce" returned: 0 in 0.307s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Lock "cinder-quobyte-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce" released by "delete_volume" :: held 0.940s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:40 devstack cinder-volume[87143]: DEBUG cinder.quota [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Created reservations ['21b9ed65-6e9c-4e65-a2af-afd3a85dd2c5', '9f8ffe26-a617-4663-b785-fccd52d47276', 'a115ccad-4819-4ee0-806b-4c4b5251c3b4', '2af4d032-c15b-4839-9830-2589aa27b1e9'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:41 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:29:41 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:41 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG cinder.manager [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:29:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Deleted volume successfully.
Nov 06 08:29:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [req-be60657c-2a4e-4bf8-b369-38191ee40fcd req-6e60ca48-7f6e-4a6a-bd47-63af3a241a77 tempest-TestShelveInstance-629874385 None] Lock "cinder-ffc6bdcb-f5d3-41c9-b0b5-49731db712ce-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:29:51 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:29:51 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Flow 'volume_create_manager' (928046e1-5895-49d4-87de-a7900af1dff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda5b73-5417-4fb4-a9bb-ba8e51e6c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda5b73-5417-4fb4-a9bb-ba8e51e6c46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-455147306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c13743f-92a0-481a-a2b7-7a2db00377ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ccbe0ed39f4fc78e7505a98e45315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:29:57Z,use_quota=True,user_id='fe6d83fae92249db9658d5bee956f986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9914e59-db75-4aa4-8073-12c693efcd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9914e59-db75-4aa4-8073-12c693efcd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd54906a-54a4-4714-9d43-94c61bc0f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd54906a-54a4-4714-9d43-94c61bc0f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c13743f-92a0-481a-a2b7-7a2db00377ae', 'volume_name': 'volume-9c13743f-92a0-481a-a2b7-7a2db00377ae', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab3cb69-62a4-41fc-a424-7c7c11bd3c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab3cb69-62a4-41fc-a424-7c7c11bd3c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ed0e0f-6171-420e-addd-5be9407f5efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:57 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Volume 9c13743f-92a0-481a-a2b7-7a2db00377ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c13743f-92a0-481a-a2b7-7a2db00377ae', 'volume_size': 1}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-455147306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c13743f-92a0-481a-a2b7-7a2db00377ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ccbe0ed39f4fc78e7505a98e45315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:29:57Z,use_quota=True,user_id='fe6d83fae92249db9658d5bee956f986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Creating volume 9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:29:57 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:29:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:57 devstack sudo[101273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae 1073741824
Nov 06 08:29:57 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:58 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae 1073741824" returned: 0 in 0.500s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:29:58 devstack sudo[101279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae
Nov 06 08:29:58 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:29:58 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae" returned: 0 in 0.264s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ed0e0f-6171-420e-addd-5be9407f5efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c13743f-92a0-481a-a2b7-7a2db00377ae', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7594d0-086d-40b5-abe1-58f2d93fb41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:29:58 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Volume volume-9c13743f-92a0-481a-a2b7-7a2db00377ae (9c13743f-92a0-481a-a2b7-7a2db00377ae): created successfully
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7594d0-086d-40b5-abe1-58f2d93fb41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:29:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Flow 'volume_create_manager' (928046e1-5895-49d4-87de-a7900af1dff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:29:58 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-721712d1-cfd8-4ffe-9f9b-d3477d03babd tempest-SnapshotDependencyTests-136447359 None] Created volume successfully.
Nov 06 08:30:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Creating offline snapshot 421e883e-6abf-464f-9c3e-02459ca63198 of volume 9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:30:00 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb865a19-97f5-4c81-8f70-83374f9503c0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:30:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:00 devstack sudo[101287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae
Nov 06 08:30:00 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:00 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae" returned: 0 in 0.549s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:00 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 1G
Nov 06 08:30:00 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:01 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 1G" returned: 0 in 0.703s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c13743f-92a0-481a-a2b7-7a2db00377ae -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:01 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c13743f-92a0-481a-a2b7-7a2db00377ae -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198
Nov 06 08:30:01 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:01 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c13743f-92a0-481a-a2b7-7a2db00377ae -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198" returned: 0 in 0.480s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:01 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 is being set with open permissions: ugo+rw
Nov 06 08:30:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:02 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198
Nov 06 08:30:02 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:02 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198" returned: 0 in 0.329s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:02 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.info
Nov 06 08:30:02 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:02 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.info" returned: 0 in 0.274s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:02 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.info is being set with open permissions: ugo+rw
Nov 06 08:30:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:02 devstack sudo[101315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.info
Nov 06 08:30:02 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:02 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.info" returned: 0 in 0.270s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.759s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a7b21ec7-6f35-4f68-bb40-da92731ac32e tempest-SnapshotDependencyTests-136447359 None] Create snapshot completed successfully
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Flow 'volume_create_manager' (43764f1d-c2fa-44ea-b20d-7d381ee6756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffa51da-f9bc-4fac-bb93-1979ba412b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffa51da-f9bc-4fac-bb93-1979ba412b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ccbe0ed39f4fc78e7505a98e45315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=421e883e-6abf-464f-9c3e-02459ca63198,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:30:04Z,use_quota=True,user_id='fe6d83fae92249db9658d5bee956f986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e2bc0c-685d-4778-a2e8-3a451e6e430c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e2bc0c-685d-4778-a2e8-3a451e6e430c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf313c08-23a6-42c8-8180-cd40f079d82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf313c08-23a6-42c8-8180-cd40f079d82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e', 'volume_name': 'volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e', 'volume_size': 1, 'snapshot_id': '421e883e-6abf-464f-9c3e-02459ca63198'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ce9e88-7568-4d3b-b5e2-2b5fbffd7a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ce9e88-7568-4d3b-b5e2-2b5fbffd7a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368f1bae-043b-4a4b-a9a4-e37597541fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:04 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Volume a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e', 'volume_size': 1, 'snapshot_id': '421e883e-6abf-464f-9c3e-02459ca63198'}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-quobyte-421e883e-6abf-464f-9c3e-02459ca63198-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-421e883e-6abf-464f-9c3e-02459ca63198-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Creating volume a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e from snapshot 421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-quobyte-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] snapshot: 421e883e-6abf-464f-9c3e-02459ca63198, volume: a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafdf5ca-ede3-482b-92cb-c58251a5543a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:04 devstack sudo[101319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198
Nov 06 08:30:04 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:04 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198" returned: 0 in 0.518s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c13743f-92a0-481a-a2b7-7a2db00377ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[468f5f2c-adf8-4b4e-94a7-ef885c748665]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:30:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:04 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae
Nov 06 08:30:04 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:05 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae" returned: 0 in 0.540s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:30:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:30:05 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:30:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:05 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e
Nov 06 08:30:05 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:30:14 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" returned: 0 in 8.995s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:30:14 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Converted 1024.00 MB image at 113.79 MB/s
Nov 06 08:30:14 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e is being set with open permissions: ugo+rw
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:14 devstack sudo[101409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e
Nov 06 08:30:14 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:14 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" returned: 0 in 0.270s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" released by "_copy_volume_from_snapshot" :: held 10.434s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-421e883e-6abf-464f-9c3e-02459ca63198-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" released by "_create_volume_from_snapshot" :: held 10.524s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.543s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368f1bae-043b-4a4b-a9a4-e37597541fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e', 'volume_size': 1, 'snapshot_id': '421e883e-6abf-464f-9c3e-02459ca63198'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4169a9-e710-4536-9477-9a92080bee08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Volume volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e (a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e): created successfully
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4169a9-e710-4536-9477-9a92080bee08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Flow 'volume_create_manager' (43764f1d-c2fa-44ea-b20d-7d381ee6756a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:30:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2f293997-ad14-4104-99ab-3c501a9fc061 tempest-SnapshotDependencyTests-136447359 None] Created volume successfully.
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-421e883e-6abf-464f-9c3e-02459ca63198-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-421e883e-6abf-464f-9c3e-02459ca63198-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-quobyte-9c13743f-92a0-481a-a2b7-7a2db00377ae" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-9c13743f-92a0-481a-a2b7-7a2db00377ae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-quobyte-421e883e-6abf-464f-9c3e-02459ca63198" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-421e883e-6abf-464f-9c3e-02459ca63198" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Deleting offline snapshot 421e883e-6abf-464f-9c3e-02459ca63198 of volume 9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] snapshot_file for this snap is: volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3439147e-e057-40d1-8a39-0453fa1491d0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:30:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:15 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198
Nov 06 08:30:15 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:16 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198" returned: 0 in 0.416s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c13743f-92a0-481a-a2b7-7a2db00377ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:30:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fca41f-c257-4149-b066-5b00c6104824]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:30:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:16 devstack sudo[101417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae
Nov 06 08:30:16 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:16 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae" returned: 0 in 0.687s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:16 devstack sudo[101423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198
Nov 06 08:30:16 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:17 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198" returned: 0 in 0.404s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:17 devstack sudo[101428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198
Nov 06 08:30:17 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:17 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae.421e883e-6abf-464f-9c3e-02459ca63198" returned: 0 in 0.269s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-421e883e-6abf-464f-9c3e-02459ca63198" released by "_delete_snapshot" :: held 1.897s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-9c13743f-92a0-481a-a2b7-7a2db00377ae" released by "delete_snapshot" :: held 1.919s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Created reservations ['44394622-acd9-442c-a116-f07c82351e9f', 'a5590c3b-9672-419b-b8c1-05e6d08c9e80', 'f63416c2-75f6-48a2-8673-7125e5a72b03', 'e915d996-c060-4536-a3b4-57dbfba57565'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:30:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Delete snapshot completed successfully.
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d23ac99a-66ea-40d1-bb58-bd2e8a45a24a tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-421e883e-6abf-464f-9c3e-02459ca63198-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-9c13743f-92a0-481a-a2b7-7a2db00377ae-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-9c13743f-92a0-481a-a2b7-7a2db00377ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-quobyte-9c13743f-92a0-481a-a2b7-7a2db00377ae" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-9c13743f-92a0-481a-a2b7-7a2db00377ae" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecc3033-cb26-4234-81b5-99d6a97a390c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:30:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:18 devstack sudo[101431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae
Nov 06 08:30:18 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:18 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae" returned: 0 in 0.403s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:18 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae
Nov 06 08:30:18 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:18 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9c13743f-92a0-481a-a2b7-7a2db00377ae" returned: 0 in 0.284s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-9c13743f-92a0-481a-a2b7-7a2db00377ae" released by "delete_volume" :: held 0.772s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Created reservations ['77e3cf12-cc38-48a0-be61-f7a2decf998f', '973332a2-57c8-4828-89fc-9f8550049a0e', 'f24fb27c-ab2b-4a92-b322-018c3c5f03c4', '3937a3b3-88ca-4f28-9077-99ab03b98349'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:18 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:30:18 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:19 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.293s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:30:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Deleted volume successfully.
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "cinder-quobyte-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-814d8b90-f0ed-44df-925d-5dc239648f13 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-9c13743f-92a0-481a-a2b7-7a2db00377ae-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[093779e1-5b18-4ae3-b479-d74ed3daecaf]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:19 devstack sudo[101443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e
Nov 06 08:30:19 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:19 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" returned: 0 in 0.429s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:19 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e
Nov 06 08:30:19 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:19 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" returned: 0 in 0.332s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-quobyte-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e" released by "delete_volume" :: held 0.835s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Created reservations ['0c27106c-7c3c-4266-8a66-4f2cd93b816d', '434cc7c3-c88f-4725-a2a8-e8e5f4c4879e', '9ddacbaa-d49d-4c43-84fa-cb5552a45ce5', '1b4afb0c-2df8-4eda-97e1-f5fb1c05b4e5'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:20 devstack sudo[101454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:30:20 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:20 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.309s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:30:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Deleted volume successfully.
Nov 06 08:30:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cbe1e803-f40d-4c89-882c-b1fff8d6e975 tempest-SnapshotDependencyTests-136447359 None] Lock "cinder-a1da4cd1-ea98-4a40-84b0-a90d10ec4e0e-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Flow 'volume_create_manager' (934874ba-8091-4b45-8a06-3530e43dfc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9df8adb-4063-4de0-8ba0-9eaecc1cc914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9df8adb-4063-4de0-8ba0-9eaecc1cc914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1920845743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e17b34-e979-4d84-b5dc-7329bc653769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdbc423eb3449e98eb0442ced780e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:30:23Z,use_quota=True,user_id='bebc04d82ae7439b82214bda667902d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a7b7d1-4f77-4bce-8b6d-c9a6db691df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a7b7d1-4f77-4bce-8b6d-c9a6db691df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678cff14-fe9b-4ae7-99e4-24095db40a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678cff14-fe9b-4ae7-99e4-24095db40a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e17b34-e979-4d84-b5dc-7329bc653769', 'volume_name': 'volume-31e17b34-e979-4d84-b5dc-7329bc653769', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9db385-7e7b-48e6-b3a2-a17c2ca7db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9db385-7e7b-48e6-b3a2-a17c2ca7db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4867d496-bb01-4f30-829f-11be792ba784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:22 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Volume 31e17b34-e979-4d84-b5dc-7329bc653769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e17b34-e979-4d84-b5dc-7329bc653769', 'volume_size': 1}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1920845743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e17b34-e979-4d84-b5dc-7329bc653769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdbc423eb3449e98eb0442ced780e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:30:23Z,use_quota=True,user_id='bebc04d82ae7439b82214bda667902d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Creating volume 31e17b34-e979-4d84-b5dc-7329bc653769 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:30:22 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:30:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:22 devstack sudo[101467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769 1073741824
Nov 06 08:30:22 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:23 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769 1073741824" returned: 0 in 0.506s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:23 devstack sudo[101473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769
Nov 06 08:30:23 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:23 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769" returned: 0 in 0.399s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4867d496-bb01-4f30-829f-11be792ba784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e17b34-e979-4d84-b5dc-7329bc653769', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35cc63f-1a86-4dc5-998d-743e207ca5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Volume volume-31e17b34-e979-4d84-b5dc-7329bc653769 (31e17b34-e979-4d84-b5dc-7329bc653769): created successfully
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35cc63f-1a86-4dc5-998d-743e207ca5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Flow 'volume_create_manager' (934874ba-8091-4b45-8a06-3530e43dfc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:30:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5edd0263-2fe9-411a-955b-d8117ba6d26a tempest-AttachVolumeNegativeTest-1994017049 None] Created volume successfully.
Nov 06 08:30:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fe3aa27a-79eb-4f0f-a2b4-828cfd8cfaff req-a37d3547-a340-4ee3-b80e-3d86514fd054 tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fe3aa27a-79eb-4f0f-a2b4-828cfd8cfaff req-a37d3547-a340-4ee3-b80e-3d86514fd054 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-fe3aa27a-79eb-4f0f-a2b4-828cfd8cfaff req-a37d3547-a340-4ee3-b80e-3d86514fd054 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-fe3aa27a-79eb-4f0f-a2b4-828cfd8cfaff req-a37d3547-a340-4ee3-b80e-3d86514fd054 tempest-AttachVolumeNegativeTest-1994017049 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-31e17b34-e979-4d84-b5dc-7329bc653769', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f5f2fef-0af9-42d9-93e1-10c80df3fc5c', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:30:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-fe3aa27a-79eb-4f0f-a2b4-828cfd8cfaff req-a37d3547-a340-4ee3-b80e-3d86514fd054 tempest-AttachVolumeNegativeTest-1994017049 None] attachment_update completed successfully.
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:30 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:30:30 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:30 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.274s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:30:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Flow 'volume_create_manager' (a61ead79-240a-486b-b91a-d25e4e515bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5062d427-33f4-4024-8ab2-351ed812396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5062d427-33f4-4024-8ab2-351ed812396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1525240366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b41854f-d9ee-427e-86dc-39d992a6e571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76e88dd7a724ec4aaa35e4cd38f320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:30:33Z,use_quota=True,user_id='88058c3b6ee743ba8f916015bb724b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12940782-23d9-4fa1-abd6-493c77c28453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12940782-23d9-4fa1-abd6-493c77c28453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723a72e8-fb14-4ed8-b2b2-7c8ae354e906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723a72e8-fb14-4ed8-b2b2-7c8ae354e906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b41854f-d9ee-427e-86dc-39d992a6e571', 'volume_name': 'volume-3b41854f-d9ee-427e-86dc-39d992a6e571', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f10d4ae-bfb5-4965-9bcb-97240d27cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f10d4ae-bfb5-4965-9bcb-97240d27cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936b7f05-d744-4c32-b3fc-f3f13daf7865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:32 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Volume 3b41854f-d9ee-427e-86dc-39d992a6e571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b41854f-d9ee-427e-86dc-39d992a6e571', 'volume_size': 1}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1525240366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b41854f-d9ee-427e-86dc-39d992a6e571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76e88dd7a724ec4aaa35e4cd38f320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:30:33Z,use_quota=True,user_id='88058c3b6ee743ba8f916015bb724b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Creating volume 3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:30:32 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:30:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:33 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 1073741824
Nov 06 08:30:33 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:33 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 1073741824" returned: 0 in 0.519s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:30:33 devstack sudo[101918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571
Nov 06 08:30:33 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:30:34 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root
Nov 06 08:30:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571" returned: 0 in 0.532s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:30:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:30:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:30:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936b7f05-d744-4c32-b3fc-f3f13daf7865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b41854f-d9ee-427e-86dc-39d992a6e571', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603fb03f-aecd-42c8-8fca-6b62a1f64efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:30:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Volume volume-3b41854f-d9ee-427e-86dc-39d992a6e571 (3b41854f-d9ee-427e-86dc-39d992a6e571): created successfully
Nov 06 08:30:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603fb03f-aecd-42c8-8fca-6b62a1f64efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:30:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Flow 'volume_create_manager' (a61ead79-240a-486b-b91a-d25e4e515bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:30:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3e4ba6c4-dba1-4535-b4ae-f17ce3723a96 tempest-TestStampPattern-2124799777 None] Created volume successfully.
Nov 06 08:30:44 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:30:44 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=34,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:31:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-568afe20-cba4-4c17-9694-63e16d1c1907 req-dceb979b-21f0-4806-8a2f-722294360f43 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-568afe20-cba4-4c17-9694-63e16d1c1907 req-dceb979b-21f0-4806-8a2f-722294360f43 tempest-TestStampPattern-2124799777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-568afe20-cba4-4c17-9694-63e16d1c1907 req-dceb979b-21f0-4806-8a2f-722294360f43 tempest-TestStampPattern-2124799777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-568afe20-cba4-4c17-9694-63e16d1c1907 req-dceb979b-21f0-4806-8a2f-722294360f43 tempest-TestStampPattern-2124799777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-3b41854f-d9ee-427e-86dc-39d992a6e571', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39f12a2c-07cc-4410-bf02-73c195dd7d1e', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:31:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-568afe20-cba4-4c17-9694-63e16d1c1907 req-dceb979b-21f0-4806-8a2f-722294360f43 tempest-TestStampPattern-2124799777 None] attachment_update completed successfully.
Nov 06 08:31:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-601d1030-60b9-4992-b6e8-a4bbe81ff22e req-16b6557c-982c-498f-9e8f-040c0ca2fe7a tempest-AttachVolumeNegativeTest-1994017049 None] Terminate volume connection completed successfully.
Nov 06 08:31:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-601d1030-60b9-4992-b6e8-a4bbe81ff22e req-16b6557c-982c-498f-9e8f-040c0ca2fe7a tempest-AttachVolumeNegativeTest-1994017049 None] Deleting attachment 8f5f2fef-0af9-42d9-93e1-10c80df3fc5c. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:31:11 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-3cd90538-65da-4fb2-8815-df868f954355 req-22b54b93-66e8-4902-b5e4-9983bb7ee4c6 tempest-TestStampPattern-2124799777 None] Terminate volume connection completed successfully.
Nov 06 08:31:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-3cd90538-65da-4fb2-8815-df868f954355 req-22b54b93-66e8-4902-b5e4-9983bb7ee4c6 tempest-TestStampPattern-2124799777 None] Deleting attachment 39f12a2c-07cc-4410-bf02-73c195dd7d1e. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:31:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:12 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Creating offline snapshot 74cc753e-8b3f-4db9-921b-948719f7f686 of volume 3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:31:12 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd068fd-0fce-4567-8075-94679ca2a532]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:31:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:12 devstack sudo[102281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571
Nov 06 08:31:12 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:12 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571" returned: 0 in 0.450s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:13 devstack sudo[102289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 1G
Nov 06 08:31:13 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:13 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 1G" returned: 0 in 0.425s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b41854f-d9ee-427e-86dc-39d992a6e571 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:13 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b41854f-d9ee-427e-86dc-39d992a6e571 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686
Nov 06 08:31:13 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:13 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b41854f-d9ee-427e-86dc-39d992a6e571 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686" returned: 0 in 0.325s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:13 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 is being set with open permissions: ugo+rw
Nov 06 08:31:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:13 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686
Nov 06 08:31:13 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:14 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686" returned: 0 in 0.270s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:14 devstack sudo[102304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.info
Nov 06 08:31:14 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:14 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.info" returned: 0 in 0.292s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:14 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.info is being set with open permissions: ugo+rw
Nov 06 08:31:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:14 devstack sudo[102307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.info
Nov 06 08:31:14 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:14 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.info" returned: 0 in 0.289s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-67a02c9a-72e4-4051-9161-482a5bf69547 tempest-TestStampPattern-2124799777 None] Create snapshot completed successfully
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Flow 'volume_create_manager' (816f4d7f-41b4-48f9-b15f-daee75a38b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6725347-5088-446c-ae89-57131ae7fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6725347-5088-446c-ae89-57131ae7fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-232151709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1662f807-ea32-4b56-a2c8-2f928a825d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76e88dd7a724ec4aaa35e4cd38f320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74cc753e-8b3f-4db9-921b-948719f7f686,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:31:24Z,use_quota=True,user_id='88058c3b6ee743ba8f916015bb724b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a789624-e64f-4695-9be2-74c4300467b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a789624-e64f-4695-9be2-74c4300467b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6645b600-ec14-451a-af65-db216509b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6645b600-ec14-451a-af65-db216509b93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1662f807-ea32-4b56-a2c8-2f928a825d26', 'volume_name': 'volume-1662f807-ea32-4b56-a2c8-2f928a825d26', 'volume_size': 1, 'snapshot_id': '74cc753e-8b3f-4db9-921b-948719f7f686'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7964649d-7f05-435e-8bea-0dfc2ab7a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7964649d-7f05-435e-8bea-0dfc2ab7a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61299dc-8f4c-42e0-909f-8e7bc3f02775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Volume 1662f807-ea32-4b56-a2c8-2f928a825d26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1662f807-ea32-4b56-a2c8-2f928a825d26', 'volume_size': 1, 'snapshot_id': '74cc753e-8b3f-4db9-921b-948719f7f686'}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-quobyte-74cc753e-8b3f-4db9-921b-948719f7f686-1662f807-ea32-4b56-a2c8-2f928a825d26" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-74cc753e-8b3f-4db9-921b-948719f7f686-1662f807-ea32-4b56-a2c8-2f928a825d26" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Creating volume 1662f807-ea32-4b56-a2c8-2f928a825d26 from snapshot 74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-quobyte-1662f807-ea32-4b56-a2c8-2f928a825d26" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-1662f807-ea32-4b56-a2c8-2f928a825d26" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] snapshot: 74cc753e-8b3f-4db9-921b-948719f7f686, volume: 1662f807-ea32-4b56-a2c8-2f928a825d26,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[646c1ee6-d5b3-48f3-bfc1-d0a4ed70d134]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:31:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:24 devstack sudo[102435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686
Nov 06 08:31:24 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:24 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686" returned: 0 in 0.672s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b41854f-d9ee-427e-86dc-39d992a6e571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:31:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e023b943-42d0-48c5-bdfe-d3e34573df32]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:31:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:24 devstack sudo[102442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571
Nov 06 08:31:24 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:25 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571" returned: 0 in 0.676s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:31:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:31:25 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:31:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:25 devstack sudo[102451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26
Nov 06 08:31:25 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:31:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:31:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:31:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:30 devstack sudo[102465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:31:30 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:31 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.939s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:31 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:31:31 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:31:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:31:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:31:33 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:31:33 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:31:36 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26" returned: 0 in 11.564s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:36 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571, size 1024.00 MB, duration 11.56 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:31:36 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Converted 1024.00 MB image at 88.54 MB/s
Nov 06 08:31:36 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26 is being set with open permissions: ugo+rw
Nov 06 08:31:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:36 devstack sudo[102560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26
Nov 06 08:31:36 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:37 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26" returned: 0 in 0.282s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-1662f807-ea32-4b56-a2c8-2f928a825d26" released by "_copy_volume_from_snapshot" :: held 13.371s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-74cc753e-8b3f-4db9-921b-948719f7f686-1662f807-ea32-4b56-a2c8-2f928a825d26" released by "_create_volume_from_snapshot" :: held 13.497s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.528s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61299dc-8f4c-42e0-909f-8e7bc3f02775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1662f807-ea32-4b56-a2c8-2f928a825d26', 'volume_size': 1, 'snapshot_id': '74cc753e-8b3f-4db9-921b-948719f7f686'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafbc38a-4ed3-4f67-94fc-458b5913fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Volume volume-1662f807-ea32-4b56-a2c8-2f928a825d26 (1662f807-ea32-4b56-a2c8-2f928a825d26): created successfully
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafbc38a-4ed3-4f67-94fc-458b5913fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Flow 'volume_create_manager' (816f4d7f-41b4-48f9-b15f-daee75a38b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:31:37 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-28d94c1a-bb3e-4165-befb-25b8bc7f7029 tempest-TestStampPattern-2124799777 None] Created volume successfully.
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Flow 'volume_create_manager' (3c4a486b-86ca-45ef-b615-b4bc295d1dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a08c73f-d495-4946-9e1f-7e05ab03c607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a08c73f-d495-4946-9e1f-7e05ab03c607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2027114611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2601c5d4-50ab-4039-8cc9-89d0131053c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdbc423eb3449e98eb0442ced780e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:31:45Z,use_quota=True,user_id='bebc04d82ae7439b82214bda667902d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f730f4-2473-414f-a539-f131aab987a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f730f4-2473-414f-a539-f131aab987a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fd8166-4364-4214-9420-70836b6fd934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fd8166-4364-4214-9420-70836b6fd934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2601c5d4-50ab-4039-8cc9-89d0131053c9', 'volume_name': 'volume-2601c5d4-50ab-4039-8cc9-89d0131053c9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5bf733-924b-4219-abf1-f2d936dd10b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5bf733-924b-4219-abf1-f2d936dd10b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e666e6-c222-493d-8ccc-97fb84f26e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Volume 2601c5d4-50ab-4039-8cc9-89d0131053c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2601c5d4-50ab-4039-8cc9-89d0131053c9', 'volume_size': 1}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2027114611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2601c5d4-50ab-4039-8cc9-89d0131053c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdbc423eb3449e98eb0442ced780e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:31:45Z,use_quota=True,user_id='bebc04d82ae7439b82214bda667902d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Creating volume 2601c5d4-50ab-4039-8cc9-89d0131053c9 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:31:45 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:45 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9 1073741824
Nov 06 08:31:45 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:45 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9 1073741824" returned: 0 in 0.435s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:31:45 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9
Nov 06 08:31:45 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:31:45 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9" returned: 0 in 0.254s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e666e6-c222-493d-8ccc-97fb84f26e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2601c5d4-50ab-4039-8cc9-89d0131053c9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eca5f77-49a5-4b5e-a4b8-aa54e7b951f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:31:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Volume volume-2601c5d4-50ab-4039-8cc9-89d0131053c9 (2601c5d4-50ab-4039-8cc9-89d0131053c9): created successfully
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eca5f77-49a5-4b5e-a4b8-aa54e7b951f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:31:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Flow 'volume_create_manager' (3c4a486b-86ca-45ef-b615-b4bc295d1dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:31:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-508fe46b-5fc7-411f-9b3a-193d38abb2cc tempest-AttachVolumeNegativeTest-1994017049 None] Created volume successfully.
Nov 06 08:31:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-c61a4a7d-36d6-49e8-a163-4d9b146697cd req-81704ce8-61d2-4ad1-8c31-ea20b8f3c5f3 tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:31:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-c61a4a7d-36d6-49e8-a163-4d9b146697cd req-81704ce8-61d2-4ad1-8c31-ea20b8f3c5f3 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:31:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-c61a4a7d-36d6-49e8-a163-4d9b146697cd req-81704ce8-61d2-4ad1-8c31-ea20b8f3c5f3 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:31:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-c61a4a7d-36d6-49e8-a163-4d9b146697cd req-81704ce8-61d2-4ad1-8c31-ea20b8f3c5f3 tempest-AttachVolumeNegativeTest-1994017049 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-2601c5d4-50ab-4039-8cc9-89d0131053c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ccf640c-4b48-43b8-b6f0-bcbc12aba939', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:31:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-c61a4a7d-36d6-49e8-a163-4d9b146697cd req-81704ce8-61d2-4ad1-8c31-ea20b8f3c5f3 tempest-AttachVolumeNegativeTest-1994017049 None] attachment_update completed successfully.
Nov 06 08:31:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-b86ff8e8-48e6-416c-896e-0cdec7f2b813 req-5b53365f-dfd2-4b53-9fb7-9f1e812906ab tempest-AttachVolumeNegativeTest-1994017049 None] Terminate volume connection completed successfully.
Nov 06 08:31:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-b86ff8e8-48e6-416c-896e-0cdec7f2b813 req-5b53365f-dfd2-4b53-9fb7-9f1e812906ab tempest-AttachVolumeNegativeTest-1994017049 None] Deleting attachment 1ccf640c-4b48-43b8-b6f0-bcbc12aba939. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:31:59 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:31:59 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:INSERT=1,cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:32:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-1171786a-8277-42ec-815d-9d3638f1100c req-df0beed0-026c-4742-b071-78b5c2de0dc3 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-1171786a-8277-42ec-815d-9d3638f1100c req-df0beed0-026c-4742-b071-78b5c2de0dc3 tempest-TestStampPattern-2124799777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-1171786a-8277-42ec-815d-9d3638f1100c req-df0beed0-026c-4742-b071-78b5c2de0dc3 tempest-TestStampPattern-2124799777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-1171786a-8277-42ec-815d-9d3638f1100c req-df0beed0-026c-4742-b071-78b5c2de0dc3 tempest-TestStampPattern-2124799777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-1662f807-ea32-4b56-a2c8-2f928a825d26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4102b55b-5962-4aab-a2a4-dfb1410246b4', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:32:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-1171786a-8277-42ec-815d-9d3638f1100c req-df0beed0-026c-4742-b071-78b5c2de0dc3 tempest-TestStampPattern-2124799777 None] attachment_update completed successfully.
Nov 06 08:32:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-7d2a9aba-f57f-42c6-aea8-27167806e59d req-da624e85-9708-4891-820c-fef9fd7fdb71 tempest-TestStampPattern-2124799777 None] Terminate volume connection completed successfully.
Nov 06 08:32:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-7d2a9aba-f57f-42c6-aea8-27167806e59d req-da624e85-9708-4891-820c-fef9fd7fdb71 tempest-TestStampPattern-2124799777 None] Deleting attachment 4102b55b-5962-4aab-a2a4-dfb1410246b4. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Flow 'volume_create_manager' (ceb6a7f3-8527-48f1-a7f8-f09d037a33c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f84a013-2a91-46e9-82cb-3f88f52fdb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f84a013-2a91-46e9-82cb-3f88f52fdb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1395464777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccd7052-7f51-43a3-b899-24327a3823da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdbc423eb3449e98eb0442ced780e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:23Z,use_quota=True,user_id='bebc04d82ae7439b82214bda667902d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb3c147-377d-459a-b80b-c313fbcfad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb3c147-377d-459a-b80b-c313fbcfad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc9e21d-3e6c-4d60-a727-bdef894edf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc9e21d-3e6c-4d60-a727-bdef894edf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ccd7052-7f51-43a3-b899-24327a3823da', 'volume_name': 'volume-2ccd7052-7f51-43a3-b899-24327a3823da', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79ebe3c-fd3d-4354-beee-9336fb3b6c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79ebe3c-fd3d-4354-beee-9336fb3b6c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6dd6c8-198d-4045-bf09-e386f4c686ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Volume 2ccd7052-7f51-43a3-b899-24327a3823da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ccd7052-7f51-43a3-b899-24327a3823da', 'volume_size': 1}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1395464777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccd7052-7f51-43a3-b899-24327a3823da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdbc423eb3449e98eb0442ced780e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:23Z,use_quota=True,user_id='bebc04d82ae7439b82214bda667902d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Creating volume 2ccd7052-7f51-43a3-b899-24327a3823da {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:23 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:23 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da 1073741824
Nov 06 08:32:23 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-1662f807-ea32-4b56-a2c8-2f928a825d26-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Lock "cinder-1662f807-ea32-4b56-a2c8-2f928a825d26-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-quobyte-1662f807-ea32-4b56-a2c8-2f928a825d26" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-1662f807-ea32-4b56-a2c8-2f928a825d26" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6d0a00-5f1c-4e96-9900-0f183d1e74ec]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:23 devstack sudo[103753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26
Nov 06 08:32:23 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:23 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da 1073741824" returned: 0 in 0.482s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:24 devstack sudo[103756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da
Nov 06 08:32:24 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:24 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26" returned: 0 in 0.386s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:24 devstack sudo[103761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26
Nov 06 08:32:24 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:24 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6dd6c8-198d-4045-bf09-e386f4c686ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccd7052-7f51-43a3-b899-24327a3823da', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d65b4a-93c6-4f2b-8eb0-b99419b7e4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:24 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Volume volume-2ccd7052-7f51-43a3-b899-24327a3823da (2ccd7052-7f51-43a3-b899-24327a3823da): created successfully
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d65b4a-93c6-4f2b-8eb0-b99419b7e4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Flow 'volume_create_manager' (ceb6a7f3-8527-48f1-a7f8-f09d037a33c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:24 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bdccbc82-e68b-4d23-a75c-bcddff2d509f tempest-AttachVolumeNegativeTest-1994017049 None] Created volume successfully.
Nov 06 08:32:24 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1662f807-ea32-4b56-a2c8-2f928a825d26" returned: 0 in 0.257s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-1662f807-ea32-4b56-a2c8-2f928a825d26" released by "delete_volume" :: held 0.688s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Created reservations ['27d75dd3-f543-4278-8fa1-b9021b2528dc', '131d9605-3962-46f6-97a6-5324ba393a7d', 'e50cc08b-8319-4b23-9147-a3607848f5b9', '2ae1f1a8-c0fb-400c-a574-9023d5a53a59'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:24 devstack sudo[103768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:24 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:24 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.260s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:24 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Deleted volume successfully.
Nov 06 08:32:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-385379c9-22b0-4e57-9ed5-0396aec13d48 tempest-TestStampPattern-2124799777 None] Lock "cinder-1662f807-ea32-4b56-a2c8-2f928a825d26-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-74cc753e-8b3f-4db9-921b-948719f7f686-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Lock "cinder-74cc753e-8b3f-4db9-921b-948719f7f686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-quobyte-3b41854f-d9ee-427e-86dc-39d992a6e571" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-3b41854f-d9ee-427e-86dc-39d992a6e571" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-quobyte-74cc753e-8b3f-4db9-921b-948719f7f686" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-74cc753e-8b3f-4db9-921b-948719f7f686" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Deleting offline snapshot 74cc753e-8b3f-4db9-921b-948719f7f686 of volume 3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] snapshot_file for this snap is: volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95a634a-9938-408c-b04f-543e22ac5aa4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-59c0094f-5196-478a-b787-a03a8b4aed77 req-46d13fd3-f1d7-4997-bc1c-c6cb71ed2a0a tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-59c0094f-5196-478a-b787-a03a8b4aed77 req-46d13fd3-f1d7-4997-bc1c-c6cb71ed2a0a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-59c0094f-5196-478a-b787-a03a8b4aed77 req-46d13fd3-f1d7-4997-bc1c-c6cb71ed2a0a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:25 devstack sudo[103779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686
Nov 06 08:32:25 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-59c0094f-5196-478a-b787-a03a8b4aed77 req-46d13fd3-f1d7-4997-bc1c-c6cb71ed2a0a tempest-AttachVolumeNegativeTest-1994017049 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-2ccd7052-7f51-43a3-b899-24327a3823da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db296aab-8e9f-48f5-98bd-76a75d747e4c', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:32:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-59c0094f-5196-478a-b787-a03a8b4aed77 req-46d13fd3-f1d7-4997-bc1c-c6cb71ed2a0a tempest-AttachVolumeNegativeTest-1994017049 None] attachment_update completed successfully.
Nov 06 08:32:25 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686" returned: 0 in 0.410s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b41854f-d9ee-427e-86dc-39d992a6e571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4909a0c-ba0c-481a-abc0-5936359a5a09]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:25 devstack sudo[103884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571
Nov 06 08:32:25 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:26 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571" returned: 0 in 0.594s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:26 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686
Nov 06 08:32:26 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:26 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686" returned: 0 in 0.332s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:26 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686
Nov 06 08:32:26 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:26 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571.74cc753e-8b3f-4db9-921b-948719f7f686" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-74cc753e-8b3f-4db9-921b-948719f7f686" released by "_delete_snapshot" :: held 1.719s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-3b41854f-d9ee-427e-86dc-39d992a6e571" released by "delete_snapshot" :: held 1.742s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:27 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Created reservations ['5c5a6a6c-8c40-42e1-92b8-92f7f969df0e', '5c975abc-a2b0-4903-a45b-6d532d1d77fe', '879fc901-7be3-4217-9464-2f7013fdcaa0', '056a0707-a03e-4ed4-b76e-0d5ab160c316'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Delete snapshot completed successfully.
Nov 06 08:32:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3797ca7c-0702-43c3-918c-25613c26818f tempest-TestStampPattern-2124799777 None] Lock "cinder-74cc753e-8b3f-4db9-921b-948719f7f686-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:28 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-4675493d-4a7b-4c31-bc53-f0d78865ab9b req-6bf994eb-11f5-4f2a-a8f6-fc3d8721cd8a tempest-AttachVolumeNegativeTest-1994017049 None] Terminate volume connection completed successfully.
Nov 06 08:32:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-4675493d-4a7b-4c31-bc53-f0d78865ab9b req-6bf994eb-11f5-4f2a-a8f6-fc3d8721cd8a tempest-AttachVolumeNegativeTest-1994017049 None] Deleting attachment db296aab-8e9f-48f5-98bd-76a75d747e4c. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:30 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:30 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:30 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.275s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:32:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-3b41854f-d9ee-427e-86dc-39d992a6e571-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Lock "cinder-3b41854f-d9ee-427e-86dc-39d992a6e571-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Acquiring lock "cinder-quobyte-3b41854f-d9ee-427e-86dc-39d992a6e571" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-3b41854f-d9ee-427e-86dc-39d992a6e571" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5664ae81-68d5-450e-a981-b8e227f18ed1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:31 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571
Nov 06 08:32:31 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:31 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571" returned: 0 in 0.364s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:31 devstack sudo[104295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571
Nov 06 08:32:31 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:31 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3b41854f-d9ee-427e-86dc-39d992a6e571" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Lock "cinder-quobyte-3b41854f-d9ee-427e-86dc-39d992a6e571" released by "delete_volume" :: held 0.683s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Created reservations ['8c7be249-47b1-4a40-a444-23c11cdce6e5', '44c117b3-b723-4407-81ab-35405227dc03', '11d5e6ca-73a7-46a2-bd14-7fc256b39e7f', '397d986f-44d2-4c37-b402-0531c52ae496'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:31 devstack sudo[104298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:31 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:32 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.263s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:32 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:32 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Deleted volume successfully.
Nov 06 08:32:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-72756ebb-2c09-4c73-85c9-9e084af8a9af tempest-TestStampPattern-2124799777 None] Lock "cinder-3b41854f-d9ee-427e-86dc-39d992a6e571-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "cinder-2ccd7052-7f51-43a3-b899-24327a3823da-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-2ccd7052-7f51-43a3-b899-24327a3823da-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "cinder-quobyte-2ccd7052-7f51-43a3-b899-24327a3823da" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-quobyte-2ccd7052-7f51-43a3-b899-24327a3823da" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eb55b6-1610-43ea-ba95-40e1617ab432]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:33 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da
Nov 06 08:32:33 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:33 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da" returned: 0 in 0.373s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:33 devstack sudo[104306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da
Nov 06 08:32:33 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:33 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2ccd7052-7f51-43a3-b899-24327a3823da" returned: 0 in 0.248s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-quobyte-2ccd7052-7f51-43a3-b899-24327a3823da" released by "delete_volume" :: held 0.684s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Created reservations ['21bbb224-0545-4433-82d3-a556d304daac', 'f71f34c1-d673-4cf5-8560-54a3adc2a9d4', '4e88badb-d5e5-4c9e-aecb-c8f6b093f6c8', '6a510db7-6154-4339-82a2-41ba92c12208'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:33 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:33 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:34 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.267s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Deleted volume successfully.
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0f5dd440-76b0-441e-87cd-30306f94213a tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-2ccd7052-7f51-43a3-b899-24327a3823da-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "cinder-2601c5d4-50ab-4039-8cc9-89d0131053c9-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-2601c5d4-50ab-4039-8cc9-89d0131053c9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "cinder-quobyte-2601c5d4-50ab-4039-8cc9-89d0131053c9" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-quobyte-2601c5d4-50ab-4039-8cc9-89d0131053c9" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[228bc64d-b724-47aa-9417-15ba594006c7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:34 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9
Nov 06 08:32:34 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:34 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9" returned: 0 in 0.364s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:34 devstack sudo[104318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9
Nov 06 08:32:34 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:34 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-2601c5d4-50ab-4039-8cc9-89d0131053c9" returned: 0 in 0.253s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-quobyte-2601c5d4-50ab-4039-8cc9-89d0131053c9" released by "delete_volume" :: held 0.667s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Created reservations ['87bb0c58-6999-416e-889e-4c863c44f593', '8044d0cd-9147-4d48-ae6d-81cd862bd238', '6cb736bd-bb4e-44b3-a61f-2e0c48b55474', 'aae478fd-86a6-478e-95b5-b7334cedae63'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:35 devstack sudo[104321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:35 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:35 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:35 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Deleted volume successfully.
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c6cebfbf-dc06-49cd-b957-5a906d5aacab tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-2601c5d4-50ab-4039-8cc9-89d0131053c9-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "cinder-31e17b34-e979-4d84-b5dc-7329bc653769-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-31e17b34-e979-4d84-b5dc-7329bc653769-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "cinder-quobyte-31e17b34-e979-4d84-b5dc-7329bc653769" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-quobyte-31e17b34-e979-4d84-b5dc-7329bc653769" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0dae94-a5d4-44e3-9a41-4e864a68dbde]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:35 devstack sudo[104324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769
Nov 06 08:32:35 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:36 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769" returned: 0 in 0.436s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:36 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769
Nov 06 08:32:36 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:36 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-31e17b34-e979-4d84-b5dc-7329bc653769" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-quobyte-31e17b34-e979-4d84-b5dc-7329bc653769" released by "delete_volume" :: held 0.747s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Created reservations ['48bf6cfc-1a37-47f8-8e81-e2d9f5bca4a0', '5f6c5fd3-f35e-4bd9-9aab-0eff46b2c5a2', '0ca66376-ee6d-4d93-8a57-0fbf42b549d5', 'e7de98b0-4209-4e22-a4ca-cf6de205185d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:36 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:36 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:36 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.271s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Deleted volume successfully.
Nov 06 08:32:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aa3fbbc-82fe-4014-bf13-0ad0f7dd4546 tempest-AttachVolumeNegativeTest-1994017049 None] Lock "cinder-31e17b34-e979-4d84-b5dc-7329bc653769-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (dae53977-d201-4e0b-a795-f297ef10a7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae0479d-a51d-4d99-8e54-b9b02e0d91f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae0479d-a51d-4d99-8e54-b9b02e0d91f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1376258746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b620966e-2eea-4e0c-b282-c1c787c97f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:44Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314b42f-10da-4bad-83a0-bd0002a774a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314b42f-10da-4bad-83a0-bd0002a774a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c4a60-9e7d-4a14-8153-5fd1296a68ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c4a60-9e7d-4a14-8153-5fd1296a68ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b620966e-2eea-4e0c-b282-c1c787c97f56', 'volume_name': 'volume-b620966e-2eea-4e0c-b282-c1c787c97f56', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f250f8f-f34d-4f6a-815f-7be8777ca3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f250f8f-f34d-4f6a-815f-7be8777ca3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77e033d-49d3-4d09-87a7-f3b72b1f2785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:44 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Volume b620966e-2eea-4e0c-b282-c1c787c97f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b620966e-2eea-4e0c-b282-c1c787c97f56', 'volume_size': 1}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1376258746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b620966e-2eea-4e0c-b282-c1c787c97f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:44Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Creating volume b620966e-2eea-4e0c-b282-c1c787c97f56 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:44 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:44 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56 1073741824
Nov 06 08:32:44 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (bbdcccb1-f9bd-42e4-99d4-b92964d4e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27907539-890a-4940-8fe9-412c7e6dc504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27907539-890a-4940-8fe9-412c7e6dc504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-733867099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883b7a90-0df1-4d3c-bcb6-a52addeee910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:45Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6d975c-9b19-4088-81b7-f52b507576ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:44 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6d975c-9b19-4088-81b7-f52b507576ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3c4bf-d903-4ce7-80f0-f14d4cbbc900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3c4bf-d903-4ce7-80f0-f14d4cbbc900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883b7a90-0df1-4d3c-bcb6-a52addeee910', 'volume_name': 'volume-883b7a90-0df1-4d3c-bcb6-a52addeee910', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935f59d5-9e23-4f7e-897d-5709c997a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935f59d5-9e23-4f7e-897d-5709c997a55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef6d540-4120-478f-9300-07932b227cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Volume 883b7a90-0df1-4d3c-bcb6-a52addeee910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883b7a90-0df1-4d3c-bcb6-a52addeee910', 'volume_size': 1}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:45 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56 1073741824" returned: 0 in 0.593s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:45 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56
Nov 06 08:32:45 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (09f9f8b4-f784-4ab9-a24e-edd62255fcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2945748f-cba8-473f-aee1-a6f0df458b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-889c967f-7363-4ed7-a7bf-c18185653fcc tempest-GroupSnapshotsTest-676154648 None] Group tempest-GroupSnapshotsTest-Group-2095576416: creating
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2945748f-cba8-473f-aee1-a6f0df458b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1075839514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8941ef7f-ed2c-48c4-bed2-17038465b3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:45Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d50d75-e65c-4118-bb2a-d2ebc652bb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d50d75-e65c-4118-bb2a-d2ebc652bb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f706884-a168-4070-9f4f-e7c684523a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f706884-a168-4070-9f4f-e7c684523a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8941ef7f-ed2c-48c4-bed2-17038465b3aa', 'volume_name': 'volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d363fe8-1532-4787-a531-a49f4f6e02c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d363fe8-1532-4787-a531-a49f4f6e02c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b24e4d-b6a2-431c-a2bd-5a8b2021c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Volume 8941ef7f-ed2c-48c4-bed2-17038465b3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa', 'volume_size': 1}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-889c967f-7363-4ed7-a7bf-c18185653fcc tempest-GroupSnapshotsTest-676154648 None] Group tempest-GroupSnapshotsTest-Group-2095576416: created successfully
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-889c967f-7363-4ed7-a7bf-c18185653fcc tempest-GroupSnapshotsTest-676154648 None] Create group completed successfully.
Nov 06 08:32:45 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56" returned: 0 in 0.301s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-733867099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883b7a90-0df1-4d3c-bcb6-a52addeee910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:45Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Creating volume 883b7a90-0df1-4d3c-bcb6-a52addeee910 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77e033d-49d3-4d09-87a7-f3b72b1f2785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b620966e-2eea-4e0c-b282-c1c787c97f56', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack sudo[104352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910 1073741824
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87281c9-9dca-4b39-a7ad-fd27d1a532b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Volume volume-b620966e-2eea-4e0c-b282-c1c787c97f56 (b620966e-2eea-4e0c-b282-c1c787c97f56): created successfully
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87281c9-9dca-4b39-a7ad-fd27d1a532b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (dae53977-d201-4e0b-a795-f297ef10a7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-be2e9de8-30f5-46a8-8420-6c88c94af80e tempest-CreateVolumesFromImageTest-1955102215 None] Created volume successfully.
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (bf1499a0-0654-4dc8-b072-9fd950138e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e2b80-5d63-4d9e-aa1f-e664ec98c0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e2b80-5d63-4d9e-aa1f-e664ec98c0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651731145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae02e0e-308c-4af6-9fe8-962732d4915b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:46Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341a846d-7702-43d4-aa58-ec36a94549b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341a846d-7702-43d4-aa58-ec36a94549b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8d4df1-24f8-43a3-afb8-c7c9c74c4ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8d4df1-24f8-43a3-afb8-c7c9c74c4ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae02e0e-308c-4af6-9fe8-962732d4915b', 'volume_name': 'volume-dae02e0e-308c-4af6-9fe8-962732d4915b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de56872-4224-45c8-a53c-931272b895a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de56872-4224-45c8-a53c-931272b895a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c18238-a624-4ac0-957c-44d5a003cb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Volume dae02e0e-308c-4af6-9fe8-962732d4915b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae02e0e-308c-4af6-9fe8-962732d4915b', 'volume_size': 1}
Nov 06 08:32:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:46 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910 1073741824" returned: 0 in 0.494s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (671f3ba9-9246-43d8-975a-5f7966b68e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf1ed1a-fe87-47cb-9ebf-f968577fe012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf1ed1a-fe87-47cb-9ebf-f968577fe012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514892636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8631864-9471-4b30-a868-8b3ee5b0b4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:46Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188e25be-cb54-470a-93b4-a14777337cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188e25be-cb54-470a-93b4-a14777337cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed1abc5-cb1b-42f0-b32c-6194980d942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed1abc5-cb1b-42f0-b32c-6194980d942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8631864-9471-4b30-a868-8b3ee5b0b4ee', 'volume_name': 'volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b5859a-25e1-432f-995d-cadf8a854f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b5859a-25e1-432f-995d-cadf8a854f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589226c2-1e92-43b7-86d7-4cf257fd3781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Volume b8631864-9471-4b30-a868-8b3ee5b0b4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee', 'volume_size': 1}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:46 devstack sudo[104358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910
Nov 06 08:32:46 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:46 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1075839514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8941ef7f-ed2c-48c4-bed2-17038465b3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:45Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Creating volume 8941ef7f-ed2c-48c4-bed2-17038465b3aa {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:46 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef6d540-4120-478f-9300-07932b227cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883b7a90-0df1-4d3c-bcb6-a52addeee910', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bead97-4d9c-40c3-b041-2accf8f31a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack sudo[104361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa 1073741824
Nov 06 08:32:46 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Volume volume-883b7a90-0df1-4d3c-bcb6-a52addeee910 (883b7a90-0df1-4d3c-bcb6-a52addeee910): created successfully
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bead97-4d9c-40c3-b041-2accf8f31a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (bbdcccb1-f9bd-42e4-99d4-b92964d4e367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-179fa780-3fc3-4f74-b374-07a2a1e157a7 tempest-CreateVolumesFromImageTest-1955102215 None] Created volume successfully.
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (8406cc50-9cc5-4cc5-b20b-095581f951f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbef377b-4ee4-4f72-8331-650637cbe5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbef377b-4ee4-4f72-8331-650637cbe5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-93658239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12e560f1-6b08-4930-94bc-2a0d14f527d0,host='devstack@QuobyteHD#QuobyteHD',id=44faae11-6f63-486f-af49-9a18228203b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:47Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0dfd409-86e6-40af-9aaa-9ae64172f640),volume_type_id=f0dfd409-86e6-40af-9aaa-9ae64172f640)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c55394a-bcb6-439f-bed3-ebb7617b4d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c55394a-bcb6-439f-bed3-ebb7617b4d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746f98f0-462e-4da7-b7b7-d89f6bc5d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746f98f0-462e-4da7-b7b7-d89f6bc5d03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44faae11-6f63-486f-af49-9a18228203b0', 'volume_name': 'volume-44faae11-6f63-486f-af49-9a18228203b0', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeecaadb-59f5-477d-8270-ec43256fdec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeecaadb-59f5-477d-8270-ec43256fdec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378682a-921f-464a-88f0-df3a0dce5256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Volume 44faae11-6f63-486f-af49-9a18228203b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44faae11-6f63-486f-af49-9a18228203b0', 'volume_size': 1}
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:46 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa 1073741824" returned: 0 in 0.522s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:47 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa
Nov 06 08:32:47 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:47 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651731145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae02e0e-308c-4af6-9fe8-962732d4915b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:46Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Creating volume dae02e0e-308c-4af6-9fe8-962732d4915b {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:47 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b24e4d-b6a2-431c-a2bd-5a8b2021c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61291f27-c0c4-43d0-a440-f317d7e4441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:47 devstack sudo[104371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b 1073741824
Nov 06 08:32:47 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:47 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Volume volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa (8941ef7f-ed2c-48c4-bed2-17038465b3aa): created successfully
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61291f27-c0c4-43d0-a440-f317d7e4441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (09f9f8b4-f784-4ab9-a24e-edd62255fcb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2935352c-e2ff-47b1-9422-5d1c15c2b770 tempest-CreateVolumesFromImageTest-1955102215 None] Created volume successfully.
Nov 06 08:32:47 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b 1073741824" returned: 0 in 0.407s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:47 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b
Nov 06 08:32:47 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:47 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.792s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514892636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8631864-9471-4b30-a868-8b3ee5b0b4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a402460f3448c0b9b8bec63a6775c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:46Z,use_quota=True,user_id='995c421c267e406c8f7bd2b9b2c84f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Creating volume b8631864-9471-4b30-a868-8b3ee5b0b4ee {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:47 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:32:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c18238-a624-4ac0-957c-44d5a003cb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae02e0e-308c-4af6-9fe8-962732d4915b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119a3d59-33fe-40d3-b49d-1c1fa31861d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:48 devstack sudo[104380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee 1073741824
Nov 06 08:32:48 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Volume volume-dae02e0e-308c-4af6-9fe8-962732d4915b (dae02e0e-308c-4af6-9fe8-962732d4915b): created successfully
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119a3d59-33fe-40d3-b49d-1c1fa31861d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (bf1499a0-0654-4dc8-b072-9fd950138e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-154220fe-d466-4aa0-b688-288ac4a9c593 tempest-CreateVolumesFromImageTest-1955102215 None] Created volume successfully.
Nov 06 08:32:48 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee 1073741824" returned: 0 in 0.447s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:48 devstack sudo[104386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee
Nov 06 08:32:48 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:48 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=12e560f1-6b08-4930-94bc-2a0d14f527d0,created_at=2026-11-06T07:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-93658239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12e560f1-6b08-4930-94bc-2a0d14f527d0,host='devstack@QuobyteHD#QuobyteHD',id=44faae11-6f63-486f-af49-9a18228203b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:32:47Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0dfd409-86e6-40af-9aaa-9ae64172f640),volume_type_id=f0dfd409-86e6-40af-9aaa-9ae64172f640)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Creating volume 44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:48 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:48 devstack sudo[104389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 1073741824
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589226c2-1e92-43b7-86d7-4cf257fd3781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:48 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a129a1f-6504-457f-9b96-d5d9ae987ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Volume volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee (b8631864-9471-4b30-a868-8b3ee5b0b4ee): created successfully
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a129a1f-6504-457f-9b96-d5d9ae987ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Flow 'volume_create_manager' (671f3ba9-9246-43d8-975a-5f7966b68e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4ccb31bd-6323-47ca-81d0-7f89304a4676 tempest-CreateVolumesFromImageTest-1955102215 None] Created volume successfully.
Nov 06 08:32:49 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 1073741824" returned: 0 in 0.423s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:49 devstack sudo[104394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0
Nov 06 08:32:49 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:49 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378682a-921f-464a-88f0-df3a0dce5256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44faae11-6f63-486f-af49-9a18228203b0', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f117a937-6c92-4aa8-818b-f0207230056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:32:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Volume volume-44faae11-6f63-486f-af49-9a18228203b0 (44faae11-6f63-486f-af49-9a18228203b0): created successfully
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f117a937-6c92-4aa8-818b-f0207230056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (8406cc50-9cc5-4cc5-b20b-095581f951f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:32:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cfe4e0d9-b93c-4765-a3b7-c9d0bd380aa0 tempest-GroupSnapshotsTest-676154648 None] Created volume successfully.
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-b8631864-9471-4b30-a868-8b3ee5b0b4ee-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-b8631864-9471-4b30-a868-8b3ee5b0b4ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-quobyte-b8631864-9471-4b30-a868-8b3ee5b0b4ee" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-b8631864-9471-4b30-a868-8b3ee5b0b4ee" acquired by "delete_volume" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b9d520-189e-4c34-8f23-95b32cf1653b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:49 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee
Nov 06 08:32:49 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:49 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:49 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee
Nov 06 08:32:49 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:50 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8631864-9471-4b30-a868-8b3ee5b0b4ee" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-b8631864-9471-4b30-a868-8b3ee5b0b4ee" released by "delete_volume" :: held 0.641s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Created reservations ['fa7400a0-0d9a-4701-b5e7-7319d17c7f2a', '90d471cb-e9b5-48c3-b593-b91d9f9b90ad', '85c4443b-d208-450a-aced-f310aae383ce', 'd01c0c05-89f2-4a7a-b085-6fbce8a2f4df'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:50 devstack sudo[104405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:50 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:50 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Deleted volume successfully.
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c781a428-00d7-4808-8f3c-7c158ff35945 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-b8631864-9471-4b30-a868-8b3ee5b0b4ee-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] GroupSnapshot ddebf333-62f1-4007-a789-d517c8865abc: creating.
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Group snapshot ddebf333-62f1-4007-a789-d517c8865abc: creating. {{(pid=87143) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-dae02e0e-308c-4af6-9fe8-962732d4915b-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Creating offline snapshot f486870d-c4bf-4610-ab14-acac42e716f8 of volume 44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-dae02e0e-308c-4af6-9fe8-962732d4915b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[452786a3-9519-43b1-9d8e-d1369a2be51e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-quobyte-dae02e0e-308c-4af6-9fe8-962732d4915b" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-dae02e0e-308c-4af6-9fe8-962732d4915b" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b2ce2-e4f8-439c-8fdd-98bb8a604c85]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:50 devstack sudo[104408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0
Nov 06 08:32:50 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:50 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b
Nov 06 08:32:50 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:51 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0" returned: 0 in 0.385s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:51 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 1G
Nov 06 08:32:51 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:51 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b" returned: 0 in 0.383s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:51 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b
Nov 06 08:32:51 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:51 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-dae02e0e-308c-4af6-9fe8-962732d4915b" returned: 0 in 0.268s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-dae02e0e-308c-4af6-9fe8-962732d4915b" released by "delete_volume" :: held 0.694s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:51 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Created reservations ['60e3e102-bed7-4fcf-8044-252436207256', 'b876d868-15e8-445f-9ac6-9b72fc6ae62f', '34bfd535-e76c-45d7-b56b-8a85f192fd1c', 'faf0d5f3-be21-4fd2-8103-286f6469c1d1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 1G" returned: 0 in 0.421s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44faae11-6f63-486f-af49-9a18228203b0 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:51 devstack sudo[104426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44faae11-6f63-486f-af49-9a18228203b0 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8
Nov 06 08:32:51 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:51 devstack sudo[104428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:51 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:51 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-8941ef7f-ed2c-48c4-bed2-17038465b3aa-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:51 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44faae11-6f63-486f-af49-9a18228203b0 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8" returned: 0 in 0.334s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:51 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.284s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-8941ef7f-ed2c-48c4-bed2-17038465b3aa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:51 devstack sudo[104434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8
Nov 06 08:32:51 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:51 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Deleted volume successfully.
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e9b0ce4a-8ddf-4ac3-b723-a8571b641c38 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-dae02e0e-308c-4af6-9fe8-962732d4915b-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-quobyte-8941ef7f-ed2c-48c4-bed2-17038465b3aa" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-8941ef7f-ed2c-48c4-bed2-17038465b3aa" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[07294d05-8c66-4c75-a5c1-989be0d1aee7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:52 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa
Nov 06 08:32:52 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:52 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8" returned: 0 in 0.266s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:52 devstack sudo[104439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.info
Nov 06 08:32:52 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:52 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa" returned: 0 in 0.363s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:52 devstack sudo[104444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa
Nov 06 08:32:52 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:52 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.info" returned: 0 in 0.269s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:52 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:52 devstack sudo[104447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.info
Nov 06 08:32:52 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:52 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8941ef7f-ed2c-48c4-bed2-17038465b3aa" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-8941ef7f-ed2c-48c4-bed2-17038465b3aa" released by "delete_volume" :: held 0.663s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:52 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Created reservations ['c63cbdfc-e33d-44b3-be08-28af7e0df3d6', 'c51b84cd-e9fe-4e4a-a0e4-0d20fbc1b064', 'd0a61106-040f-4221-82ab-b9d1bb08e91f', 'ad7106ec-4010-4406-b1ab-fc56f68ed931'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.info" returned: 0 in 0.256s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f040cf3b-15fe-4a38-b4a4-1c2e6d701793 tempest-GroupSnapshotsTest-676154648 None] group_snapshot ddebf333-62f1-4007-a789-d517c8865abc: created successfully
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:52 devstack sudo[104451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:52 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-883b7a90-0df1-4d3c-bcb6-a52addeee910-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-883b7a90-0df1-4d3c-bcb6-a52addeee910-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:53 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.256s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:53 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Deleted volume successfully.
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-quobyte-883b7a90-0df1-4d3c-bcb6-a52addeee910" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-84956743-266e-4bc4-b83b-9d5e961955fb tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-8941ef7f-ed2c-48c4-bed2-17038465b3aa-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-883b7a90-0df1-4d3c-bcb6-a52addeee910" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[498c429f-036e-4949-9542-e74613767835]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:53 devstack sudo[104454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910
Nov 06 08:32:53 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:53 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:53 devstack sudo[104459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910
Nov 06 08:32:53 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:53 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-883b7a90-0df1-4d3c-bcb6-a52addeee910" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-883b7a90-0df1-4d3c-bcb6-a52addeee910" released by "delete_volume" :: held 0.640s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Created reservations ['bfa19bbd-f57d-491e-b014-35b933aacf14', 'b36fa071-e87a-443c-b702-7a9e97be44b2', '53e4feb2-8b90-495f-af53-af5994563658', '3e3eb14c-d25c-4a49-9745-99bccb951bad'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:53 devstack sudo[104462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:53 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:54 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Deleted volume successfully.
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b1035d55-5f1c-43e9-b5ad-a3edea4d7730 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-883b7a90-0df1-4d3c-bcb6-a52addeee910-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-b620966e-2eea-4e0c-b282-c1c787c97f56-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-b620966e-2eea-4e0c-b282-c1c787c97f56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "cinder-quobyte-b620966e-2eea-4e0c-b282-c1c787c97f56" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-b620966e-2eea-4e0c-b282-c1c787c97f56" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c8309e-1874-4948-833c-8d5dcc61f47a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:54 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56
Nov 06 08:32:54 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-f486870d-c4bf-4610-ab14-acac42e716f8-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-f486870d-c4bf-4610-ab14-acac42e716f8-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Creating volume 870b9fc7-51f6-43bf-9b87-b35d4eda69fe from snapshot f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] snapshot: f486870d-c4bf-4610-ab14-acac42e716f8, volume: 870b9fc7-51f6-43bf-9b87-b35d4eda69fe,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ccfb29-6996-4a19-b847-378b64d7de1b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:54 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56" returned: 0 in 0.403s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:54 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56
Nov 06 08:32:54 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:54 devstack sudo[104469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8
Nov 06 08:32:54 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:54 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b620966e-2eea-4e0c-b282-c1c787c97f56" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-quobyte-b620966e-2eea-4e0c-b282-c1c787c97f56" released by "delete_volume" :: held 0.713s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:32:54 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8" returned: 0 in 0.379s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44faae11-6f63-486f-af49-9a18228203b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ae6c9a-3014-4cfd-b2fd-d4fccfe72450]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Created reservations ['2de559c3-e954-4501-90ea-a8e9900e96d0', 'f438f3af-1993-41e8-b534-ecd7552ec0b5', 'f110c731-c8a7-44ec-a7d5-5461a88e8cca', '2d296880-99e9-45e5-881d-5834c79d1911'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:55 devstack sudo[104478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0
Nov 06 08:32:55 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:55 devstack sudo[104480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:32:55 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:55 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:55 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0" returned: 0 in 0.388s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:32:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Deleted volume successfully.
Nov 06 08:32:55 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe
Nov 06 08:32:55 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:32:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-23e5e1e0-070e-402d-9d94-aaf7ba8678c1 tempest-CreateVolumesFromImageTest-1955102215 None] Lock "cinder-b620966e-2eea-4e0c-b282-c1c787c97f56-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Flow 'volume_create_manager' (8cb4651a-b4dd-4a51-9c48-06a9d081ad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada5214-2f1e-4141-addf-12fa8ae97222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada5214-2f1e-4141-addf-12fa8ae97222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1949376836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621f2006-2b09-4588-aa4b-87bd656cfa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f846097e6a7d4649a4a5549cc19e0d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:00Z,use_quota=True,user_id='589a6d219d554bed98c8a82f8ca23c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88266fcd-d23d-4174-9cde-8afc511b1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88266fcd-d23d-4174-9cde-8afc511b1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ab67b1-6e38-460f-afa4-1ada25b03a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ab67b1-6e38-460f-afa4-1ada25b03a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621f2006-2b09-4588-aa4b-87bd656cfa60', 'volume_name': 'volume-621f2006-2b09-4588-aa4b-87bd656cfa60', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333bc106-b99f-4636-9501-907ee08af342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333bc106-b99f-4636-9501-907ee08af342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046a212e-4e1c-40fa-a4a3-01fe6111f270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:00 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Volume 621f2006-2b09-4588-aa4b-87bd656cfa60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621f2006-2b09-4588-aa4b-87bd656cfa60', 'volume_size': 1}
Nov 06 08:33:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:02 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" returned: 0 in 6.846s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:33:02 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Converted 1024.00 MB image at 149.54 MB/s
Nov 06 08:33:02 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:02 devstack sudo[104500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe
Nov 06 08:33:02 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:02 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" released by "_copy_volume_from_snapshot" :: held 7.955s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-f486870d-c4bf-4610-ab14-acac42e716f8-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" released by "_create_volume_from_snapshot" :: held 8.019s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.040s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1949376836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621f2006-2b09-4588-aa4b-87bd656cfa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f846097e6a7d4649a4a5549cc19e0d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:00Z,use_quota=True,user_id='589a6d219d554bed98c8a82f8ca23c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Creating volume 621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:33:02 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:02 devstack sudo[104503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 1073741824
Nov 06 08:33:02 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c73fc890-fec3-4a35-a179-7a01744fba88 tempest-GroupSnapshotsTest-676154648 None] Create group from source-snapshot-ddebf333-62f1-4007-a789-d517c8865abc completed successfully.
Nov 06 08:33:02 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 1073741824" returned: 0 in 0.406s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:03 devstack sudo[104510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60
Nov 06 08:33:03 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:03 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046a212e-4e1c-40fa-a4a3-01fe6111f270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621f2006-2b09-4588-aa4b-87bd656cfa60', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f2ffcc-3252-4a51-b1e4-4699be026345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:03 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Volume volume-621f2006-2b09-4588-aa4b-87bd656cfa60 (621f2006-2b09-4588-aa4b-87bd656cfa60): created successfully
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f2ffcc-3252-4a51-b1e4-4699be026345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Flow 'volume_create_manager' (8cb4651a-b4dd-4a51-9c48-06a9d081ad97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:03 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fbeb3e41-ecec-4f8c-a8ec-35c7b76e281a tempest-VolumeDependencyTests-73882110 None] Created volume successfully.
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Creating offline snapshot 9238d7f4-63bb-4721-adbf-4b67f4f51078 of volume 621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[939c624e-48db-4224-b31f-14a05da0c8bd]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:03 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60
Nov 06 08:33:03 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:03 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60" returned: 0 in 0.372s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:03 devstack sudo[104518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 1G
Nov 06 08:33:03 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df99a88-57a7-492f-af2e-bb4b832bbf7c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:04 devstack sudo[104520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe
Nov 06 08:33:04 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:04 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 1G" returned: 0 in 0.401s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621f2006-2b09-4588-aa4b-87bd656cfa60 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:04 devstack sudo[104525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621f2006-2b09-4588-aa4b-87bd656cfa60 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078
Nov 06 08:33:04 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:04 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" returned: 0 in 0.393s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:04 devstack sudo[104530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe
Nov 06 08:33:04 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:04 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621f2006-2b09-4588-aa4b-87bd656cfa60 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078" returned: 0 in 0.290s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:04 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 is being set with open permissions: ugo+rw
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:04 devstack sudo[104535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078
Nov 06 08:33:04 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:04 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-870b9fc7-51f6-43bf-9b87-b35d4eda69fe" released by "delete_volume" :: held 0.703s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['7dff4a2e-c88c-495d-809a-b7eade77d1b8'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:04 devstack cinder-volume[87143]: WARNING cinder.quota [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-447393937 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-447393937, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:04 devstack cinder-volume[87143]: WARNING cinder.quota [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-447393937 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-447393937, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:04 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078" returned: 0 in 0.256s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['f6f8430c-4ddb-4413-b3bf-d59931e48d7d', '1f3d3349-39b4-434f-aee2-88c49d44e38b', '88d18861-22a0-4d90-93b9-c54a0e9eef47', '796344c7-4c24-43ef-b0b5-c212fa19a99a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:04 devstack sudo[104539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.info
Nov 06 08:33:04 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:05 devstack sudo[104541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:05 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:05 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.info" returned: 0 in 0.262s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:05 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.info is being set with open permissions: ugo+rw
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:05 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.info
Nov 06 08:33:05 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:05 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3f28573c-b3de-477a-bdf8-fe5d3aeb51b0 tempest-GroupSnapshotsTest-676154648 None] Delete group completed successfully.
Nov 06 08:33:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] group_snapshot ddebf333-62f1-4007-a789-d517c8865abc: deleting
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] group_snapshot ddebf333-62f1-4007-a789-d517c8865abc: deleting {{(pid=87143) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-44faae11-6f63-486f-af49-9a18228203b0" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-44faae11-6f63-486f-af49-9a18228203b0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-f486870d-c4bf-4610-ab14-acac42e716f8" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-f486870d-c4bf-4610-ab14-acac42e716f8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Deleting offline snapshot f486870d-c4bf-4610-ab14-acac42e716f8 of volume 44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] snapshot_file for this snap is: volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:33:05 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.info" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e628e4-d888-406f-b04e-102881b3b566]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b0e091f7-cd25-427c-8cb1-7c9c836d85a8 tempest-VolumeDependencyTests-73882110 None] Create snapshot completed successfully
Nov 06 08:33:05 devstack sudo[104548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8
Nov 06 08:33:05 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:05 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8" returned: 0 in 0.375s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44faae11-6f63-486f-af49-9a18228203b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af14a7-5884-4c8a-b779-04bd437133a5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:06 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0
Nov 06 08:33:06 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Flow 'volume_create_manager' (21200c6e-f912-4bae-9f04-8a700ccbddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24e5768-c6c9-4e22-8e3f-041278d51843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24e5768-c6c9-4e22-8e3f-041278d51843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1147127619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940a37d0-213b-411a-8bad-9a8da84c4116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f846097e6a7d4649a4a5549cc19e0d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9238d7f4-63bb-4721-adbf-4b67f4f51078,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:06Z,use_quota=True,user_id='589a6d219d554bed98c8a82f8ca23c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c138595b-4121-4731-9ae0-884f23c94c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c138595b-4121-4731-9ae0-884f23c94c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d2d5ad-5595-4d28-940f-37f9bc05786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d2d5ad-5595-4d28-940f-37f9bc05786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '940a37d0-213b-411a-8bad-9a8da84c4116', 'volume_name': 'volume-940a37d0-213b-411a-8bad-9a8da84c4116', 'volume_size': 1, 'snapshot_id': '9238d7f4-63bb-4721-adbf-4b67f4f51078'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7c8d05-a826-4f25-b260-0c69a1b00151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7c8d05-a826-4f25-b260-0c69a1b00151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8586ffd1-c348-486f-88a8-9deee0cb4107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:06 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Volume 940a37d0-213b-411a-8bad-9a8da84c4116: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-940a37d0-213b-411a-8bad-9a8da84c4116', 'volume_size': 1, 'snapshot_id': '9238d7f4-63bb-4721-adbf-4b67f4f51078'}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-quobyte-9238d7f4-63bb-4721-adbf-4b67f4f51078-940a37d0-213b-411a-8bad-9a8da84c4116" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-9238d7f4-63bb-4721-adbf-4b67f4f51078-940a37d0-213b-411a-8bad-9a8da84c4116" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Creating volume 940a37d0-213b-411a-8bad-9a8da84c4116 from snapshot 9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-quobyte-940a37d0-213b-411a-8bad-9a8da84c4116" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-940a37d0-213b-411a-8bad-9a8da84c4116" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] snapshot: 9238d7f4-63bb-4721-adbf-4b67f4f51078, volume: 940a37d0-213b-411a-8bad-9a8da84c4116,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f2f5ce-aa13-4400-85aa-8ab75a93cdf1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:06 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0" returned: 0 in 0.570s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:06 devstack sudo[104559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078
Nov 06 08:33:06 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:06 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8
Nov 06 08:33:06 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:06 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078" returned: 0 in 0.380s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621f2006-2b09-4588-aa4b-87bd656cfa60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[006eb3e3-3f02-4b66-bad7-8b4b4f373505]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:06 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8" returned: 0 in 0.336s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:06 devstack sudo[104572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8
Nov 06 08:33:06 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:06 devstack sudo[104571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60
Nov 06 08:33:06 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:07 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0.f486870d-c4bf-4610-ab14-acac42e716f8" returned: 0 in 0.286s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-f486870d-c4bf-4610-ab14-acac42e716f8" released by "_delete_snapshot" :: held 1.719s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-44faae11-6f63-486f-af49-9a18228203b0" released by "delete_snapshot" :: held 1.740s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:07 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60" returned: 0 in 0.387s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:07 devstack sudo[104580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116
Nov 06 08:33:07 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:07 devstack cinder-volume[87143]: WARNING cinder.quota [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-447393937 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-447393937, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:07 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['343aec7e-61b3-4f36-95c3-baca08e31c2f', '40453b8e-1b55-4f0b-b106-67cf1bb23896', 'f8cd54a7-76fa-439d-b40e-201002fd1e59', 'c0528c50-0771-42a9-ba5b-b2fa46aa6298'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:07 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ce869c57-cb61-4f3d-8386-09d31d224711 tempest-GroupSnapshotsTest-676154648 None] group_snapshot ddebf333-62f1-4007-a789-d517c8865abc: deleted successfully
Nov 06 08:33:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-44faae11-6f63-486f-af49-9a18228203b0" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-44faae11-6f63-486f-af49-9a18228203b0" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:08 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b10b2-b759-4eee-b1d9-57df5a0c2ef9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:08 devstack sudo[104592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0
Nov 06 08:33:08 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:08 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0" returned: 0 in 0.692s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:09 devstack sudo[104597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0
Nov 06 08:33:09 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:09 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-44faae11-6f63-486f-af49-9a18228203b0" returned: 0 in 0.544s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:09 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-44faae11-6f63-486f-af49-9a18228203b0" released by "delete_volume" :: held 1.447s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:09 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['a5ddfcc9-fc26-4aa8-9875-3cf497416be5'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:09 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=127,cinder:UPDATE=137,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:33:09 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=122,cinder:UPDATE=141,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:33:09 devstack cinder-volume[87143]: WARNING cinder.db.api [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-447393937']
Nov 06 08:33:09 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['499c9ec6-e35e-4567-82ec-3fb6510e707c', '27f96c8d-1208-4060-bd3a-ec510d75045b', '396d7ea4-ba55-4a97-b157-e9f24f692edb', 'f667d045-a4eb-4911-9f13-ce56eb2f91f1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:10 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:10 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:10 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.363s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:10 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-44bd1478-967a-4e77-ada2-40c622e0fc89 tempest-GroupSnapshotsTest-676154648 None] Delete group completed successfully.
Nov 06 08:33:11 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d3dbbe8c-9274-4c78-96e4-2d475504545e tempest-GroupSnapshotsTest-676154648 None] Group tempest-GroupSnapshotsTest-Group-1781406101: creating
Nov 06 08:33:11 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d3dbbe8c-9274-4c78-96e4-2d475504545e tempest-GroupSnapshotsTest-676154648 None] Group tempest-GroupSnapshotsTest-Group-1781406101: created successfully
Nov 06 08:33:11 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d3dbbe8c-9274-4c78-96e4-2d475504545e tempest-GroupSnapshotsTest-676154648 None] Create group completed successfully.
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (a4415b4f-9e80-44b5-b4fb-24ccf41fa7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b880eaed-744e-4d5e-9d55-5f07445cc1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b880eaed-744e-4d5e-9d55-5f07445cc1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-649802677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fa2cee48-e48a-4a2a-97f8-ab10e73032b9,host='devstack@QuobyteHD#QuobyteHD',id=89326f97-9178-4b1c-8fa8-d2c1d782f36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:13Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331a2ede-793c-4bdd-a049-e1efd0f9a37e),volume_type_id=331a2ede-793c-4bdd-a049-e1efd0f9a37e)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24e9260-35eb-4f68-8de6-318de0085e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24e9260-35eb-4f68-8de6-318de0085e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276d7088-b6bb-44d6-8df8-e88954bd7e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276d7088-b6bb-44d6-8df8-e88954bd7e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89326f97-9178-4b1c-8fa8-d2c1d782f36c', 'volume_name': 'volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782bc7ea-2a87-4968-a8ec-d2c1ff7222e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782bc7ea-2a87-4968-a8ec-d2c1ff7222e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdac56e9-f579-4366-8120-65622057a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:13 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Volume 89326f97-9178-4b1c-8fa8-d2c1d782f36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c', 'volume_size': 1}
Nov 06 08:33:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:14 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116" returned: 0 in 6.877s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:33:14 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Converted 1024.00 MB image at 148.89 MB/s
Nov 06 08:33:14 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116 is being set with open permissions: ugo+rw
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:14 devstack sudo[104646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116
Nov 06 08:33:14 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:14 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116" returned: 0 in 0.235s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-940a37d0-213b-411a-8bad-9a8da84c4116" released by "_copy_volume_from_snapshot" :: held 7.961s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-9238d7f4-63bb-4721-adbf-4b67f4f51078-940a37d0-213b-411a-8bad-9a8da84c4116" released by "_create_volume_from_snapshot" :: held 8.021s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.037s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.902s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fa2cee48-e48a-4a2a-97f8-ab10e73032b9,created_at=2026-11-06T07:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-649802677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fa2cee48-e48a-4a2a-97f8-ab10e73032b9,host='devstack@QuobyteHD#QuobyteHD',id=89326f97-9178-4b1c-8fa8-d2c1d782f36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:13Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331a2ede-793c-4bdd-a049-e1efd0f9a37e),volume_type_id=331a2ede-793c-4bdd-a049-e1efd0f9a37e)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Creating volume 89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:33:14 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:14 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c 1073741824
Nov 06 08:33:14 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8586ffd1-c348-486f-88a8-9deee0cb4107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940a37d0-213b-411a-8bad-9a8da84c4116', 'volume_size': 1, 'snapshot_id': '9238d7f4-63bb-4721-adbf-4b67f4f51078'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da9deed-5b47-4255-b644-22c5f0694136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Volume volume-940a37d0-213b-411a-8bad-9a8da84c4116 (940a37d0-213b-411a-8bad-9a8da84c4116): created successfully
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da9deed-5b47-4255-b644-22c5f0694136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Flow 'volume_create_manager' (21200c6e-f912-4bae-9f04-8a700ccbddd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-43141bb4-b010-4571-bfff-b1a71fbf1c28 tempest-VolumeDependencyTests-73882110 None] Created volume successfully.
Nov 06 08:33:14 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c 1073741824" returned: 0 in 0.410s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:14 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c
Nov 06 08:33:14 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-9238d7f4-63bb-4721-adbf-4b67f4f51078-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-9238d7f4-63bb-4721-adbf-4b67f4f51078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-quobyte-621f2006-2b09-4588-aa4b-87bd656cfa60" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-621f2006-2b09-4588-aa4b-87bd656cfa60" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-quobyte-9238d7f4-63bb-4721-adbf-4b67f4f51078" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-9238d7f4-63bb-4721-adbf-4b67f4f51078" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Deleting offline snapshot 9238d7f4-63bb-4721-adbf-4b67f4f51078 of volume 621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] snapshot_file for this snap is: volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d35e7d-1ced-4c23-b4ba-d8d805106f3f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:15 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c" returned: 0 in 0.256s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdac56e9-f579-4366-8120-65622057a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a6ef37-f91d-49dd-8567-7a6a7761949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Volume volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c (89326f97-9178-4b1c-8fa8-d2c1d782f36c): created successfully
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a6ef37-f91d-49dd-8567-7a6a7761949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:15 devstack sudo[104657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (a4415b4f-9e80-44b5-b4fb-24ccf41fa7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:15 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ee017752-9c01-4c2f-9c3d-f402761f18ba tempest-GroupSnapshotsTest-676154648 None] Created volume successfully.
Nov 06 08:33:15 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078" returned: 0 in 0.364s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621f2006-2b09-4588-aa4b-87bd656cfa60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c11e6-d411-4c4a-9240-0d453fda07f5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:15 devstack sudo[104663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60
Nov 06 08:33:15 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:15 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60" returned: 0 in 0.542s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:15 devstack sudo[104668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078
Nov 06 08:33:15 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (5b088069-12dc-415e-9129-6dbfbab58656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b44302b-9310-4581-b7eb-b114cfe564a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b44302b-9310-4581-b7eb-b114cfe564a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495206246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fa2cee48-e48a-4a2a-97f8-ab10e73032b9,host='devstack@QuobyteHD#QuobyteHD',id=9766cb83-3b6c-4a24-b193-81d98bc5dcef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:16Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331a2ede-793c-4bdd-a049-e1efd0f9a37e),volume_type_id=331a2ede-793c-4bdd-a049-e1efd0f9a37e)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57042905-a254-4ebe-a27b-562f11ccadd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57042905-a254-4ebe-a27b-562f11ccadd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ffee87-22a5-4d12-88ad-e0d83a75fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ffee87-22a5-4d12-88ad-e0d83a75fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9766cb83-3b6c-4a24-b193-81d98bc5dcef', 'volume_name': 'volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49376df4-66e5-4e58-95f8-e248a876d878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49376df4-66e5-4e58-95f8-e248a876d878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc745ea-25c0-41d8-9aaf-bb3b7b4efa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Volume 9766cb83-3b6c-4a24-b193-81d98bc5dcef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef', 'volume_size': 1}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fa2cee48-e48a-4a2a-97f8-ab10e73032b9,created_at=2026-11-06T07:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495206246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fa2cee48-e48a-4a2a-97f8-ab10e73032b9,host='devstack@QuobyteHD#QuobyteHD',id=9766cb83-3b6c-4a24-b193-81d98bc5dcef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:16Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331a2ede-793c-4bdd-a049-e1efd0f9a37e),volume_type_id=331a2ede-793c-4bdd-a049-e1efd0f9a37e)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Creating volume 9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:33:16 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:16 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078" returned: 0 in 0.433s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:16 devstack sudo[104674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef 1073741824
Nov 06 08:33:16 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:16 devstack sudo[104675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078
Nov 06 08:33:16 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:16 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60.9238d7f4-63bb-4721-adbf-4b67f4f51078" returned: 0 in 0.257s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-9238d7f4-63bb-4721-adbf-4b67f4f51078" released by "_delete_snapshot" :: held 1.702s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-621f2006-2b09-4588-aa4b-87bd656cfa60" released by "delete_snapshot" :: held 1.722s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Created reservations ['e1673e0a-3295-4efe-ae00-a66884412ab1', '5937f198-6ba7-455d-a1cb-007b8da02475', '2c545d53-09c4-4773-9ddf-a7383fee614d', '2f28c9d2-f3ea-4015-ab24-c8fb91975af6'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:16 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Delete snapshot completed successfully.
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5580ee1c-48bb-471d-ae20-a28c6090fe20 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-9238d7f4-63bb-4721-adbf-4b67f4f51078-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:16 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef 1073741824" returned: 0 in 0.446s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:16 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef
Nov 06 08:33:16 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:17 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef" returned: 0 in 0.263s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-621f2006-2b09-4588-aa4b-87bd656cfa60-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc745ea-25c0-41d8-9aaf-bb3b7b4efa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb66ad90-516a-470d-90d6-70bc10ae8301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-621f2006-2b09-4588-aa4b-87bd656cfa60-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:17 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Volume volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef (9766cb83-3b6c-4a24-b193-81d98bc5dcef): created successfully
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb66ad90-516a-470d-90d6-70bc10ae8301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (5b088069-12dc-415e-9129-6dbfbab58656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b57d45ed-39cd-4777-955d-2766fd86257e tempest-GroupSnapshotsTest-676154648 None] Created volume successfully.
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-quobyte-621f2006-2b09-4588-aa4b-87bd656cfa60" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-621f2006-2b09-4588-aa4b-87bd656cfa60" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfc7fa1-8868-49c0-ae4b-b8d9ac7c8729]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:17 devstack sudo[104687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60
Nov 06 08:33:17 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5f295521-2608-4cf4-8a23-e8cb829c9637 tempest-GroupSnapshotsTest-676154648 None] Update group completed successfully.
Nov 06 08:33:17 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:17 devstack sudo[104693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60
Nov 06 08:33:17 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:17 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-621f2006-2b09-4588-aa4b-87bd656cfa60" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-621f2006-2b09-4588-aa4b-87bd656cfa60" released by "delete_volume" :: held 0.688s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Created reservations ['625d3266-a199-4aa2-b6b8-ceda8c06e60e', '8cb8b425-8346-40c3-bd5c-0f3d10f4d2c0', '74467780-777e-43f5-86d8-13200d0d8b6e', '31a86a7f-969c-4612-b371-f491822f2b70'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:18 devstack sudo[104696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:18 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:18 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Deleted volume successfully.
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-940a37d0-213b-411a-8bad-9a8da84c4116-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cee60fe-b650-4cbe-b48d-c5a4e0c35d88 tempest-VolumeDependencyTests-73882110 None] Lock "cinder-621f2006-2b09-4588-aa4b-87bd656cfa60-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Lock "cinder-940a37d0-213b-411a-8bad-9a8da84c4116-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Acquiring lock "cinder-quobyte-940a37d0-213b-411a-8bad-9a8da84c4116" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-940a37d0-213b-411a-8bad-9a8da84c4116" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f642d48-0f50-48f1-9556-d65428d5cb6d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:18 devstack sudo[104699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116
Nov 06 08:33:18 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:18 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116" returned: 0 in 0.373s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:18 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116
Nov 06 08:33:18 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8587b795-2d64-45ea-921d-53421e760183 tempest-GroupSnapshotsTest-676154648 None] Update group completed successfully.
Nov 06 08:33:18 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-940a37d0-213b-411a-8bad-9a8da84c4116" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Lock "cinder-quobyte-940a37d0-213b-411a-8bad-9a8da84c4116" released by "delete_volume" :: held 0.658s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Created reservations ['24a1574e-60f8-4798-8670-07298742e65a', 'aa6b6d9f-3fc7-4f56-8811-1c0c7b4d98b0', 'c87958e6-5b9d-4e3a-90d4-ab8d5dc2aa11', '2c3e234e-0bb8-49aa-869b-358353a6b3ac'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:19 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:19 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:19 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Deleted volume successfully.
Nov 06 08:33:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5915c251-d2f8-41f6-b0f3-0458578c63bb tempest-VolumeDependencyTests-73882110 None] Lock "cinder-940a37d0-213b-411a-8bad-9a8da84c4116-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9cfba4ef-7bac-458b-ae6d-a2b01a58209f tempest-GroupSnapshotsTest-676154648 None] Update group completed successfully.
Nov 06 08:33:21 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-24ddda8d-fe51-4082-b1f6-b51d676cbfe7 tempest-GroupSnapshotsTest-676154648 None] Update group completed successfully.
Nov 06 08:33:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] GroupSnapshot 1c9806ba-9403-4c4e-a9d5-9698a22afafb: creating.
Nov 06 08:33:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Group snapshot 1c9806ba-9403-4c4e-a9d5-9698a22afafb: creating. {{(pid=87143) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 08:33:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Creating offline snapshot 8248600c-660f-49c2-b886-3ff82dd4cbf3 of volume 9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:33:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b1ae08-1800-4234-9380-32769dad9cd0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:22 devstack sudo[104711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef
Nov 06 08:33:22 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:23 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef" returned: 0 in 0.410s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:23 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 1G
Nov 06 08:33:23 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:23 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 1G" returned: 0 in 0.424s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:23 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3
Nov 06 08:33:23 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:23 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3" returned: 0 in 0.305s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:23 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:23 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3
Nov 06 08:33:23 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:24 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:24 devstack sudo[104732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.info
Nov 06 08:33:24 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:24 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.info" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:24 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:24 devstack sudo[104735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.info
Nov 06 08:33:24 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:24 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.info" returned: 0 in 0.269s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Flow 'volume_create_manager' (1a69e261-d7b3-4da5-b477-ef392cd7644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fb2f1b-2cf0-4811-bb43-9fdfdebccc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Creating offline snapshot aa3261fc-33cf-4692-8c5f-bd48a969d0a0 of volume 89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fb2f1b-2cf0-4811-bb43-9fdfdebccc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a24c15a-8c91-4483-8a7d-8d8897b86cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9926340219e4c82834abcc21ff604e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:25Z,use_quota=True,user_id='3d867e669a2944d7ac42068249ab76ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3977e6cc-b82c-45d7-81c9-820a84c8f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3977e6cc-b82c-45d7-81c9-820a84c8f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ef851f-7702-4992-aaf9-d95ee8bc0e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f4f90d-ab41-47b8-b3f8-16c605912fdc]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:24 devstack sudo[104738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c
Nov 06 08:33:24 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ef851f-7702-4992-aaf9-d95ee8bc0e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a24c15a-8c91-4483-8a7d-8d8897b86cd3', 'volume_name': 'volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3', 'volume_size': 1, 'image_id': 'bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e468a9dd3f9531bb1074c322a87c31b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9926340219e4c82834abcc21ff604e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01a2b94732acb24bfa571df5b1ab9192b528afeda071305130eebad4ac16178563e28aa1b017619997c916cb082abb1fc2be1a3e6f651a1fa7c34c4b53783681', 'id': 'bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'created_at': datetime.datetime(2026, 11, 6, 7, 33, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 33, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc57500>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ffbf77-03b2-434e-86ff-733082a420d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ffbf77-03b2-434e-86ff-733082a420d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b219be9-18fc-4a5a-993e-e2dbfd8ec586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:25 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Volume 6a24c15a-8c91-4483-8a7d-8d8897b86cd3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3', 'volume_size': 1, 'image_id': 'bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e468a9dd3f9531bb1074c322a87c31b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9926340219e4c82834abcc21ff604e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01a2b94732acb24bfa571df5b1ab9192b528afeda071305130eebad4ac16178563e28aa1b017619997c916cb082abb1fc2be1a3e6f651a1fa7c34c4b53783681', 'id': 'bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'created_at': datetime.datetime(2026, 11, 6, 7, 33, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 33, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc57500>}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Trying to clone 6a24c15a-8c91-4483-8a7d-8d8897b86cd3 from image bfb91eab-5ab3-4182-a1a6-83807ef11a28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:33:25 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c" returned: 0 in 0.381s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:33:25 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 08:33:25 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 1G
Nov 06 08:33:25 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[754e6912-39fd-4656-b5bc-2fcc8c1050ce]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:25 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD
Nov 06 08:33:25 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:25 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 1G" returned: 0 in 0.391s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:25 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:25 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0
Nov 06 08:33:25 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:25 devstack sudo[104753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD
Nov 06 08:33:25 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:25 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0" returned: 0 in 0.297s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:25 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:25 devstack sudo[104760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0
Nov 06 08:33:25 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:25 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Temporary image bfb91eab-5ab3-4182-a1a6-83807ef11a28 is fetched for user 3d867e669a2944d7ac42068249ab76ff. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e7955-0406-47ad-963f-eb6ad7a9fa84]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:26 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD
Nov 06 08:33:26 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:26 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:26 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.info
Nov 06 08:33:26 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:26 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:26 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.info" returned: 0 in 0.252s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:26 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:26 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.info
Nov 06 08:33:26 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:26 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD
Nov 06 08:33:26 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:26 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:26 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.info" returned: 0 in 0.252s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a24c15a-8c91-4483-8a7d-8d8897b86cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9926340219e4c82834abcc21ff604e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:25Z,use_quota=True,user_id='3d867e669a2944d7ac42068249ab76ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Creating volume 6a24c15a-8c91-4483-8a7d-8d8897b86cd3 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:33:26 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:26 devstack sudo[104780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 1073741824
Nov 06 08:33:26 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5f58ff93-9ff7-49d3-b783-b6a9e0206972 tempest-GroupSnapshotsTest-676154648 None] group_snapshot 1c9806ba-9403-4c4e-a9d5-9698a22afafb: created successfully
Nov 06 08:33:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] group_snapshot 1c9806ba-9403-4c4e-a9d5-9698a22afafb: deleting
Nov 06 08:33:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] group_snapshot 1c9806ba-9403-4c4e-a9d5-9698a22afafb: deleting {{(pid=87143) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-9766cb83-3b6c-4a24-b193-81d98bc5dcef" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-9766cb83-3b6c-4a24-b193-81d98bc5dcef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-8248600c-660f-49c2-b886-3ff82dd4cbf3" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-8248600c-660f-49c2-b886-3ff82dd4cbf3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Deleting offline snapshot 8248600c-660f-49c2-b886-3ff82dd4cbf3 of volume 9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] snapshot_file for this snap is: volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1d7f0b-9ba6-4970-9d28-d78b18134067]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:27 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 1073741824" returned: 0 in 0.489s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:27 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3
Nov 06 08:33:27 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:27 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3
Nov 06 08:33:27 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:27 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3" returned: 0 in 0.257s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Attempting download of bfb91eab-5ab3-4182-a1a6-83807ef11a28 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'metadata': {}}])) to volume 6a24c15a-8c91-4483-8a7d-8d8897b86cd3. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:33:27 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3" returned: 0 in 0.405s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0137a535-e21b-43a0-97bc-6380ff4d1c1b]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfb91eab-5ab3-4182-a1a6-83807ef11a28_yc4q1u1c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e45b37-0aa2-47e7-8513-57715e0a20e3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:27 devstack sudo[104794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfb91eab-5ab3-4182-a1a6-83807ef11a28_yc4q1u1c
Nov 06 08:33:27 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:27 devstack sudo[104795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef
Nov 06 08:33:27 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:27 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfb91eab-5ab3-4182-a1a6-83807ef11a28_yc4q1u1c" returned: 0 in 0.337s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb91eab-5ab3-4182-a1a6-83807ef11a28_yc4q1u1c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:27 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef" returned: 0 in 0.380s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:27 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3
Nov 06 08:33:27 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:27 devstack sudo[104802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb91eab-5ab3-4182-a1a6-83807ef11a28_yc4q1u1c
Nov 06 08:33:27 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:28 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb91eab-5ab3-4182-a1a6-83807ef11a28_yc4q1u1c" returned: 1 in 0.337s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb91eab-5ab3-4182-a1a6-83807ef11a28_yc4q1u1c' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eefd91-7677-4c16-be3a-2a6e4ad8ed5c]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:28 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3" returned: 0 in 0.345s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:28 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3
Nov 06 08:33:28 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:28 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD
Nov 06 08:33:28 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:28 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef.8248600c-660f-49c2-b886-3ff82dd4cbf3" returned: 0 in 0.253s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:28 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-8248600c-660f-49c2-b886-3ff82dd4cbf3" released by "_delete_snapshot" :: held 1.503s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-9766cb83-3b6c-4a24-b193-81d98bc5dcef" released by "delete_snapshot" :: held 1.528s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-89326f97-9178-4b1c-8fa8-d2c1d782f36c" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-89326f97-9178-4b1c-8fa8-d2c1d782f36c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-aa3261fc-33cf-4692-8c5f-bd48a969d0a0" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-aa3261fc-33cf-4692-8c5f-bd48a969d0a0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Deleting offline snapshot aa3261fc-33cf-4692-8c5f-bd48a969d0a0 of volume 89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] snapshot_file for this snap is: volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94e3d15-681a-4e12-a7d8-32381614d66a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:28 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD
Nov 06 08:33:28 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:28 devstack sudo[104820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0
Nov 06 08:33:28 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:28 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] bfb91eab-5ab3-4182-a1a6-83807ef11a28 was raw, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:28 devstack sudo[104826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3
Nov 06 08:33:28 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:28 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0" returned: 0 in 0.362s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8537d2c7-636b-464d-9644-1e0c41ec232f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:29 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c
Nov 06 08:33:29 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:29 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3" returned: 0 in 0.429s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfb91eab-5ab3-4182-a1a6-83807ef11a28_xu0u0l9xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:33:29 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:29 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 1G
Nov 06 08:33:29 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:29 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:29 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0
Nov 06 08:33:29 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:29 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 1G" returned: 0 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Downloaded image bfb91eab-5ab3-4182-a1a6-83807ef11a28 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'metadata': {}}])) to volume 6a24c15a-8c91-4483-8a7d-8d8897b86cd3 successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Temporary image bfb91eab-5ab3-4182-a1a6-83807ef11a28 for user 3d867e669a2944d7ac42068249ab76ff is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Marking volume 6a24c15a-8c91-4483-8a7d-8d8897b86cd3 as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Copying metadata from image bfb91eab-5ab3-4182-a1a6-83807ef11a28 to 6a24c15a-8c91-4483-8a7d-8d8897b86cd3. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Creating volume glance metadata for volume 6a24c15a-8c91-4483-8a7d-8d8897b86cd3 backed by image bfb91eab-5ab3-4182-a1a6-83807ef11a28 with: {'image_id': 'bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e468a9dd3f9531bb1074c322a87c31b4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b219be9-18fc-4a5a-993e-e2dbfd8ec586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3', 'volume_size': 1, 'image_id': 'bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e468a9dd3f9531bb1074c322a87c31b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9926340219e4c82834abcc21ff604e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01a2b94732acb24bfa571df5b1ab9192b528afeda071305130eebad4ac16178563e28aa1b017619997c916cb082abb1fc2be1a3e6f651a1fa7c34c4b53783681', 'id': 'bfb91eab-5ab3-4182-a1a6-83807ef11a28', 'created_at': datetime.datetime(2026, 11, 6, 7, 33, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 33, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfb91eab-5ab3-4182-a1a6-83807ef11a28/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc57500>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09f7524-8038-4eee-ac27-eaab3ff4643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:29 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Volume volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 (6a24c15a-8c91-4483-8a7d-8d8897b86cd3): created successfully
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09f7524-8038-4eee-ac27-eaab3ff4643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Flow 'volume_create_manager' (1a69e261-d7b3-4da5-b477-ef392cd7644d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7d1d4d04-c533-45de-acc2-93c6883437b3 tempest-VolumeImageDependencyTests-2016862526 None] Created volume successfully.
Nov 06 08:33:29 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0" returned: 0 in 0.332s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:29 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0
Nov 06 08:33:29 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Acquiring lock "cinder-6a24c15a-8c91-4483-8a7d-8d8897b86cd3-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Lock "cinder-6a24c15a-8c91-4483-8a7d-8d8897b86cd3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:30 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c.aa3261fc-33cf-4692-8c5f-bd48a969d0a0" returned: 0 in 0.274s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-aa3261fc-33cf-4692-8c5f-bd48a969d0a0" released by "_delete_snapshot" :: held 1.451s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-89326f97-9178-4b1c-8fa8-d2c1d782f36c" released by "delete_snapshot" :: held 1.473s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Acquiring lock "cinder-quobyte-6a24c15a-8c91-4483-8a7d-8d8897b86cd3" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Lock "cinder-quobyte-6a24c15a-8c91-4483-8a7d-8d8897b86cd3" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d14b010-5f3f-4893-b79c-a22883acb113]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:30 devstack cinder-volume[87143]: WARNING cinder.quota [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1227032729 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1227032729, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:30 devstack cinder-volume[87143]: WARNING cinder.quota [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1227032729 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1227032729, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['03b52c1f-e18a-450d-b68e-20399f5c2ca4', '481da75d-e27f-4bde-9b17-9802d3209040', '0f172153-c685-49a8-909c-560779b03a0f', '2c6474ec-f075-4529-90b8-fe6d1b5ce3c0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:30 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3
Nov 06 08:33:30 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['aad5f1c4-3d4f-4f4f-af83-b46563950540', '0d601481-8cc8-4240-9a68-82b4f84af9ca', '554c4cf0-a009-4f38-891d-188c64e4d289', '4dba9b75-6c14-43ce-8122-4847f21e5a8a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c44b3e33-2f79-4a10-85e7-cb0fe0ac8510 tempest-GroupSnapshotsTest-676154648 None] group_snapshot 1c9806ba-9403-4c4e-a9d5-9698a22afafb: deleted successfully
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:30 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:30 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:30 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:30 devstack sudo[104859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3
Nov 06 08:33:30 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:30 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.260s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:33:30 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-6a24c15a-8c91-4483-8a7d-8d8897b86cd3" returned: 0 in 0.279s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Lock "cinder-quobyte-6a24c15a-8c91-4483-8a7d-8d8897b86cd3" released by "delete_volume" :: held 0.739s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-89326f97-9178-4b1c-8fa8-d2c1d782f36c" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-89326f97-9178-4b1c-8fa8-d2c1d782f36c" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ede9f1c-226d-4c18-8646-80ec9b2a8208]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Created reservations ['951ac161-e08d-4a07-92a4-be7621532587', 'e0e74e48-fdab-400e-a44d-fe913bb7d4fa', '6aaf1163-e5eb-4b38-968e-64fdccf93286', '6d772e26-ca8d-471d-858c-5b13facc17e9'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:31 devstack sudo[104863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c
Nov 06 08:33:31 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:31 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:31 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:31 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.277s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:31 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Deleted volume successfully.
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9cd9dc9c-def9-40af-8acf-44a8d25fa2fa tempest-VolumeImageDependencyTests-2016862526 None] Lock "cinder-6a24c15a-8c91-4483-8a7d-8d8897b86cd3-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:31 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c" returned: 0 in 0.431s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:31 devstack sudo[104871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c
Nov 06 08:33:31 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:31 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-89326f97-9178-4b1c-8fa8-d2c1d782f36c" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-89326f97-9178-4b1c-8fa8-d2c1d782f36c" released by "delete_volume" :: held 0.751s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-9766cb83-3b6c-4a24-b193-81d98bc5dcef" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-9766cb83-3b6c-4a24-b193-81d98bc5dcef" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8776736-2dae-4802-9206-e0e11f41c9e5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:31 devstack sudo[104874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef
Nov 06 08:33:31 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:32 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef" returned: 0 in 0.379s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:32 devstack sudo[104879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef
Nov 06 08:33:32 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:32 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9766cb83-3b6c-4a24-b193-81d98bc5dcef" returned: 0 in 0.279s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-9766cb83-3b6c-4a24-b193-81d98bc5dcef" released by "delete_volume" :: held 0.718s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Created reservations ['2ddef5a6-db29-4a79-b992-22a86b2963cd'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:32 devstack cinder-volume[87143]: WARNING cinder.quota [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1227032729 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1227032729, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Created reservations ['5c0bc684-e820-4937-85d4-61236bdf0254', '719480d0-2381-43d3-a5cb-24cd13ac04b4', 'f273942a-3932-4dce-89e6-4ccef5df4ffb', 'a1bf1dc3-97e7-4ae6-a1b2-35651917b7ca'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Created reservations ['918b2915-752c-4b1d-b241-d33327268405', '647d3900-f438-4cfe-9096-67c0dfbaa2b9', 'a58a1487-7c49-4a31-b43a-5f385cbf2143', 'ad8d8bf8-8967-44b0-a5f8-b9346457c9ad'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:32 devstack sudo[104882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:32 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:32 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:32 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:32 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cd4f7962-7542-4ed5-b8ee-747d168da15e tempest-GroupSnapshotsTest-676154648 None] Delete group completed successfully.
Nov 06 08:33:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-505e6649-8cf6-49c5-9395-63a9414a0949 tempest-GroupSnapshotsTest-676154648 None] Group tempest-GroupSnapshotsTest-Group-895425517: creating
Nov 06 08:33:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-505e6649-8cf6-49c5-9395-63a9414a0949 tempest-GroupSnapshotsTest-676154648 None] Group tempest-GroupSnapshotsTest-Group-895425517: created successfully
Nov 06 08:33:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-505e6649-8cf6-49c5-9395-63a9414a0949 tempest-GroupSnapshotsTest-676154648 None] Create group completed successfully.
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (0b10e779-f826-4699-a660-ac281c320b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f012dedc-ebda-473b-bdca-b34a6a47336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f012dedc-ebda-473b-bdca-b34a6a47336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041283407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6d030335-6082-450f-a035-9e2cd16dbbe2,host='devstack@QuobyteHD#QuobyteHD',id=763af3ab-a73d-48c7-acb3-f039db2c61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:35Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1341950-cfcb-44b2-ae45-e68c9f155802),volume_type_id=b1341950-cfcb-44b2-ae45-e68c9f155802)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1c299c-8976-4008-9425-6fd3e733248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1c299c-8976-4008-9425-6fd3e733248d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee35e76-4d47-40f7-a2f7-bbf0280faad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee35e76-4d47-40f7-a2f7-bbf0280faad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763af3ab-a73d-48c7-acb3-f039db2c61c8', 'volume_name': 'volume-763af3ab-a73d-48c7-acb3-f039db2c61c8', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c96c39-98a7-4c0b-8904-fb655760af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c96c39-98a7-4c0b-8904-fb655760af3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c09cbb-ddfa-470d-aac5-06990ff96557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Volume 763af3ab-a73d-48c7-acb3-f039db2c61c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763af3ab-a73d-48c7-acb3-f039db2c61c8', 'volume_size': 1}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6d030335-6082-450f-a035-9e2cd16dbbe2,created_at=2026-11-06T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041283407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6d030335-6082-450f-a035-9e2cd16dbbe2,host='devstack@QuobyteHD#QuobyteHD',id=763af3ab-a73d-48c7-acb3-f039db2c61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cd7de566f84358812e3a8df0d40047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:35Z,use_quota=True,user_id='6a8c8a11cdc942209965ebd9bfeb3ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1341950-cfcb-44b2-ae45-e68c9f155802),volume_type_id=b1341950-cfcb-44b2-ae45-e68c9f155802)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Creating volume 763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:33:35 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:35 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 1073741824
Nov 06 08:33:35 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:35 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 1073741824" returned: 0 in 0.455s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:35 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8
Nov 06 08:33:35 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:36 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8" returned: 0 in 0.254s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c09cbb-ddfa-470d-aac5-06990ff96557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763af3ab-a73d-48c7-acb3-f039db2c61c8', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b26484-9fc2-47fa-888f-06c15d2f66de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:36 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Volume volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 (763af3ab-a73d-48c7-acb3-f039db2c61c8): created successfully
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b26484-9fc2-47fa-888f-06c15d2f66de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Flow 'volume_create_manager' (0b10e779-f826-4699-a660-ac281c320b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-98fc2911-f470-4dfc-b3e0-4bb86131f1a2 tempest-GroupSnapshotsTest-676154648 None] Created volume successfully.
Nov 06 08:33:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] GroupSnapshot 967178e1-4db8-47eb-9b1f-dbab892c77ea: creating.
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Group snapshot 967178e1-4db8-47eb-9b1f-dbab892c77ea: creating. {{(pid=87143) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Creating offline snapshot 900947ab-6857-47b3-961c-4ffb6f890036 of volume 763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d4b404-7717-44e7-9248-36ade4bf2752]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:36 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8
Nov 06 08:33:36 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:37 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8" returned: 0 in 0.398s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:37 devstack sudo[104901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 1G
Nov 06 08:33:37 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:37 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 1G" returned: 0 in 0.407s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:37 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036
Nov 06 08:33:37 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:37 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036" returned: 0 in 0.289s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:37 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:37 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036
Nov 06 08:33:37 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:38 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:38 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.info
Nov 06 08:33:38 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:38 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.info" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:38 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:38 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.info
Nov 06 08:33:38 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:38 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.info" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d54f0be5-d589-4e73-a418-8757d9202ab3 tempest-GroupSnapshotsTest-676154648 None] group_snapshot 967178e1-4db8-47eb-9b1f-dbab892c77ea: created successfully
Nov 06 08:33:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] group_snapshot 967178e1-4db8-47eb-9b1f-dbab892c77ea: deleting
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] group_snapshot 967178e1-4db8-47eb-9b1f-dbab892c77ea: deleting {{(pid=87143) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-763af3ab-a73d-48c7-acb3-f039db2c61c8" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-763af3ab-a73d-48c7-acb3-f039db2c61c8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-900947ab-6857-47b3-961c-4ffb6f890036" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-900947ab-6857-47b3-961c-4ffb6f890036" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Deleting offline snapshot 900947ab-6857-47b3-961c-4ffb6f890036 of volume 763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] snapshot_file for this snap is: volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc50cde-8931-4481-9ed4-6c86e3ad7c44]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:39 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036
Nov 06 08:33:39 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:39 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036" returned: 0 in 0.366s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-763af3ab-a73d-48c7-acb3-f039db2c61c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[678955a9-0108-401a-89d2-83f0f4df9b89]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:39 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8
Nov 06 08:33:39 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:39 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8" returned: 0 in 0.353s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:39 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036
Nov 06 08:33:39 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:40 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036" returned: 0 in 0.326s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:40 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036
Nov 06 08:33:40 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:40 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8.900947ab-6857-47b3-961c-4ffb6f890036" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-900947ab-6857-47b3-961c-4ffb6f890036" released by "_delete_snapshot" :: held 1.393s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-763af3ab-a73d-48c7-acb3-f039db2c61c8" released by "delete_snapshot" :: held 1.412s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:40 devstack cinder-volume[87143]: WARNING cinder.quota [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-573100257 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-573100257, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:40 devstack cinder-volume[87143]: WARNING cinder.quota [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-573100257 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-573100257, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:40 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] Created reservations ['7a42c20e-d840-4971-a8a2-35040b52f708', 'ae706694-2333-4283-abfb-f930b9e159e7', '69ce5aed-315a-46ef-b795-10b73fd25ccc', '081fe763-7861-4f2b-b254-024e902aa1a9'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:40 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ede8c9ee-ef4f-4287-b5ba-81f360da801a tempest-GroupSnapshotsTest-676154648 None] group_snapshot 967178e1-4db8-47eb-9b1f-dbab892c77ea: deleted successfully
Nov 06 08:33:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "cinder-quobyte-763af3ab-a73d-48c7-acb3-f039db2c61c8" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-763af3ab-a73d-48c7-acb3-f039db2c61c8" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:41 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b748a-ef7d-4ab3-96cc-1241918954e8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:41 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8
Nov 06 08:33:41 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:41 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:42 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8
Nov 06 08:33:42 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:42 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-763af3ab-a73d-48c7-acb3-f039db2c61c8" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Lock "cinder-quobyte-763af3ab-a73d-48c7-acb3-f039db2c61c8" released by "delete_volume" :: held 0.669s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['a4e75f44-3e17-4d93-845e-a1945cc8616c'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:42 devstack cinder-volume[87143]: WARNING cinder.quota [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-573100257 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-573100257, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Created reservations ['825b4f6a-188c-443b-8aa1-91d73d6dcff5', '633a6c87-342f-4a17-aaea-cedacb9bdeed', 'd67aa0b0-0c12-447b-9e47-f8a0b77da6cb', '26baccb3-e62d-489c-b743-ad8e634b00ab'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:42 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:33:42 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:42 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.236s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:42 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:33:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cf718b48-db12-4c62-a19c-b486534fda05 tempest-GroupSnapshotsTest-676154648 None] Delete group completed successfully.
Nov 06 08:33:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-de5e5fc5-a5ef-4bf7-bb96-5940233f7fe4 tempest-GroupsV314Test-37990161 None] Group tempest-GroupsV314Test-Group-173447258: creating
Nov 06 08:33:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-de5e5fc5-a5ef-4bf7-bb96-5940233f7fe4 tempest-GroupsV314Test-37990161 None] Group tempest-GroupsV314Test-Group-173447258: created successfully
Nov 06 08:33:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-de5e5fc5-a5ef-4bf7-bb96-5940233f7fe4 tempest-GroupsV314Test-37990161 None] Create group completed successfully.
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Flow 'volume_create_manager' (b26962da-5572-4759-9c9c-33b311c932f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad04615-8eaa-4b94-8b3d-a78352bf90d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad04615-8eaa-4b94-8b3d-a78352bf90d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673834185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=208a5a50-e46e-4f83-954d-3d32262a7603,host='devstack@QuobyteHD#QuobyteHD',id=ac401789-b6ab-4c89-8dfd-61e0fc50683f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063048b4877644a990b36989d430f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:49Z,use_quota=True,user_id='9ace48c802244746a989238e599be024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66c3c9a5-73e2-42ed-94cd-02e303a805ee),volume_type_id=66c3c9a5-73e2-42ed-94cd-02e303a805ee)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c436e8c6-0ebf-444d-810e-442aac12f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c436e8c6-0ebf-444d-810e-442aac12f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335a9d5f-fa88-4163-ac27-82b45f00376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335a9d5f-fa88-4163-ac27-82b45f00376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac401789-b6ab-4c89-8dfd-61e0fc50683f', 'volume_name': 'volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e19ce78-e59d-4dae-975f-1d2ba024fb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e19ce78-e59d-4dae-975f-1d2ba024fb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4da0b0-f777-40a9-83ed-275dd2ee1b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Volume ac401789-b6ab-4c89-8dfd-61e0fc50683f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f', 'volume_size': 1}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=208a5a50-e46e-4f83-954d-3d32262a7603,created_at=2026-11-06T07:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673834185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=208a5a50-e46e-4f83-954d-3d32262a7603,host='devstack@QuobyteHD#QuobyteHD',id=ac401789-b6ab-4c89-8dfd-61e0fc50683f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063048b4877644a990b36989d430f11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:33:49Z,use_quota=True,user_id='9ace48c802244746a989238e599be024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66c3c9a5-73e2-42ed-94cd-02e303a805ee),volume_type_id=66c3c9a5-73e2-42ed-94cd-02e303a805ee)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Creating volume ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:33:49 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:49 devstack sudo[104951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f 1073741824
Nov 06 08:33:49 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:49 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f 1073741824" returned: 0 in 0.406s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:49 devstack sudo[104957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f
Nov 06 08:33:49 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:50 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:33:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4da0b0-f777-40a9-83ed-275dd2ee1b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f535d7d7-8058-4618-8c49-3b0c7b80f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:33:50 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Volume volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f (ac401789-b6ab-4c89-8dfd-61e0fc50683f): created successfully
Nov 06 08:33:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f535d7d7-8058-4618-8c49-3b0c7b80f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:33:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Flow 'volume_create_manager' (b26962da-5572-4759-9c9c-33b311c932f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:33:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-06e0e113-41a4-42b8-9019-cb0823bc8f7a tempest-GroupsV314Test-37990161 None] Created volume successfully.
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:51 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Cloning volume ac401789-b6ab-4c89-8dfd-61e0fc50683f to volume ad5a0377-3fad-4b23-b29f-85f3588736b8
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Creating offline snapshot 051c3d6f-2781-4572-b849-f92871fd926b of volume ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc50436f-d1dd-4e39-8f54-54345c4b1b33]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:51 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f
Nov 06 08:33:51 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:51 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f" returned: 0 in 0.376s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:51 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b 1G
Nov 06 08:33:51 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:51 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b 1G" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:51 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b
Nov 06 08:33:51 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:52 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b" returned: 0 in 0.281s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:52 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:52 devstack sudo[104977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b
Nov 06 08:33:52 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:52 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:52 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.info
Nov 06 08:33:52 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:52 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.info" returned: 0 in 0.249s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:52 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:52 devstack sudo[104983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.info
Nov 06 08:33:52 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:53 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.info" returned: 0 in 0.236s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Acquiring lock "cinder-quobyte-ad5a0377-3fad-4b23-b29f-85f3588736b8" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-ad5a0377-3fad-4b23-b29f-85f3588736b8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] snapshot: 051c3d6f-2781-4572-b849-f92871fd926b, volume: ad5a0377-3fad-4b23-b29f-85f3588736b8,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af82b8-6b9e-42a2-8446-39061dab74bd]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:53 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b
Nov 06 08:33:53 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:53 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b" returned: 0 in 0.349s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[70751384-7b5f-4292-b951-28c5efc372ee]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:53 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f
Nov 06 08:33:53 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:53 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f" returned: 0 in 0.367s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:33:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:53 devstack sudo[104996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8
Nov 06 08:33:53 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:59 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8" returned: 0 in 5.800s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:33:59 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Converted 1024.00 MB image at 176.51 MB/s
Nov 06 08:33:59 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:33:59 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8
Nov 06 08:33:59 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:33:59 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8" returned: 0 in 0.249s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-ad5a0377-3fad-4b23-b29f-85f3588736b8" released by "_copy_volume_from_snapshot" :: held 6.830s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Acquiring lock "cinder-quobyte-051c3d6f-2781-4572-b849-f92871fd926b" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-051c3d6f-2781-4572-b849-f92871fd926b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Deleting offline snapshot 051c3d6f-2781-4572-b849-f92871fd926b of volume ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] snapshot_file for this snap is: volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c674dea-0bed-4dde-a850-49f24ad5da8d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:33:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:00 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b
Nov 06 08:34:00 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:00 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b" returned: 0 in 0.344s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:34:00 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a2a6fe-ca4e-44a9-8c53-039598831078]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:00 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f
Nov 06 08:34:00 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:00 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f" returned: 0 in 0.542s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:00 devstack sudo[105023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b
Nov 06 08:34:00 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:01 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b" returned: 0 in 0.335s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:01 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b
Nov 06 08:34:01 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:01 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f.051c3d6f-2781-4572-b849-f92871fd926b" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-051c3d6f-2781-4572-b849-f92871fd926b" released by "_delete_snapshot" :: held 1.564s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.339s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ebb4c360-0173-4304-bf9d-9b547ec350f9 tempest-GroupsV314Test-37990161 None] Create group from source-group-208a5a50-e46e-4f83-954d-3d32262a7603 completed successfully.
Nov 06 08:34:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Acquiring lock "cinder-quobyte-ad5a0377-3fad-4b23-b29f-85f3588736b8" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-ad5a0377-3fad-4b23-b29f-85f3588736b8" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:02 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[04587490-1131-47de-a36c-f538eaa74d50]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:02 devstack sudo[105031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8
Nov 06 08:34:02 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:03 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8" returned: 0 in 0.363s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:03 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8
Nov 06 08:34:03 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:03 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ad5a0377-3fad-4b23-b29f-85f3588736b8" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-ad5a0377-3fad-4b23-b29f-85f3588736b8" released by "delete_volume" :: held 0.654s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Created reservations ['c225b5af-cdb0-4c40-8446-6a2cd56e0baf'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:03 devstack cinder-volume[87143]: WARNING cinder.quota [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1868718962 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1868718962, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:34:03 devstack cinder-volume[87143]: WARNING cinder.quota [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1868718962 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1868718962, it is now deprecated. Please use the default quota class for default quota.
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Created reservations ['c2aa122b-6ca5-48bf-855b-1f2375b6fb5f', '84a9f8aa-bb48-4aa0-af62-53a008720012', 'e8cac7b6-4a4b-4aba-a4a2-01d4026f30dc', 'fc1a5d64-43a4-4113-a209-bd718bd050f1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:03 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:34:03 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:03 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:03 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:34:03 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d03d3894-5a84-4359-a324-63fe2dec54da tempest-GroupsV314Test-37990161 None] Delete group completed successfully.
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Acquiring lock "cinder-quobyte-ac401789-b6ab-4c89-8dfd-61e0fc50683f" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-ac401789-b6ab-4c89-8dfd-61e0fc50683f" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d255e12a-c9bf-4250-b6b2-e348a2e90b60]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:04 devstack sudo[105043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f
Nov 06 08:34:04 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:04 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:04 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f
Nov 06 08:34:04 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:04 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ac401789-b6ab-4c89-8dfd-61e0fc50683f" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Lock "cinder-quobyte-ac401789-b6ab-4c89-8dfd-61e0fc50683f" released by "delete_volume" :: held 0.670s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Created reservations ['8dbb8b77-5559-4cd9-887b-5ce93e2d3d9a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Created reservations ['47fcfe21-1781-4300-949f-e240c8d041ad', '9b8c9181-102a-4aac-ac9d-274815a8ede5', 'fcb1d4d5-b6aa-4159-bfe0-0757188effa7', 'a3882570-f7cd-4222-ad6a-3aa657e6b1cc'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:04 devstack sudo[105052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:34:04 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:05 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:05 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:34:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cfc2c2c5-8f15-4bfb-a0cf-a01a626d67bb tempest-GroupsV314Test-37990161 None] Delete group completed successfully.
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=141,cinder:INSERT=35,cinder:UPDATE=149,cinder:DELETE=6 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:INSERT=41,cinder:UPDATE=137,cinder:SELECT=124,cinder:DELETE=3 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Flow 'volume_create_manager' (9bc4e7c7-4488-4c54-85c7-e55710a31666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da265d2e-9e91-4699-8ec5-237ba18c86f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da265d2e-9e91-4699-8ec5-237ba18c86f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-735911299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b422c530b48fd93f07faf8922167f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:11Z,use_quota=True,user_id='7a8be4bf1be9410ab9b41fcc09e28d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9197a3-85a7-4386-99ec-56cbf79e3199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9197a3-85a7-4386-99ec-56cbf79e3199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b117b225-30ad-4869-9e80-89b376ac94e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b117b225-30ad-4869-9e80-89b376ac94e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5', 'volume_name': 'volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172ed484-5f4a-4c27-9b0e-e8b0720178ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172ed484-5f4a-4c27-9b0e-e8b0720178ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c861244f-718e-494a-83aa-2e8ab60e5a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:11 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Volume bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5', 'volume_size': 1}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-735911299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53b422c530b48fd93f07faf8922167f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:11Z,use_quota=True,user_id='7a8be4bf1be9410ab9b41fcc09e28d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Creating volume bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:34:11 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:11 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 1073741824
Nov 06 08:34:11 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:11 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 1073741824" returned: 0 in 0.416s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:11 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5
Nov 06 08:34:11 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:11 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:34:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c861244f-718e-494a-83aa-2e8ab60e5a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031e4899-d8f4-4fd2-a82e-cfd7c9620fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:12 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Volume volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 (bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5): created successfully
Nov 06 08:34:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031e4899-d8f4-4fd2-a82e-cfd7c9620fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:12 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Flow 'volume_create_manager' (9bc4e7c7-4488-4c54-85c7-e55710a31666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-56f56ba2-7711-47d3-a852-2cbfa4182978 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Created volume successfully.
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Acquiring lock "cinder-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "cinder-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Acquiring lock "cinder-quobyte-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "cinder-quobyte-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03cb196-1fec-4328-8896-b5492e9a8ed5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:13 devstack sudo[105072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5
Nov 06 08:34:13 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:13 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:13 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5
Nov 06 08:34:13 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:13 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "cinder-quobyte-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5" released by "delete_volume" :: held 0.647s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Created reservations ['a3ce31ea-43d2-4abb-a20b-4edb66afc06b', 'f227e8fe-c330-49e6-8090-bc7ef0933db2', 'e3091e5d-6920-48cf-8142-6f18d7044c31', '35952697-3050-4734-a120-6a05409d7e3d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:14 devstack sudo[105080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:34:14 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:14 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:14 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:34:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Deleted volume successfully.
Nov 06 08:34:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-10c2b61c-bb0b-4d6a-b4a5-e0ab0d460e70 tempest-VolumeQuotasNegativeTestJSON-1545362034 None] Lock "cinder-bcb3de7d-97ac-46c7-9ff3-dce8dfabfed5-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:24 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:34:24 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:30 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:34:30 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:30 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:34:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Flow 'volume_create_manager' (9134bfbb-b194-4671-acbc-763ddba69931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895b57aa-5388-419b-b29e-322a08f6c94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895b57aa-5388-419b-b29e-322a08f6c94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-865272902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669b1977-6e58-44b7-8905-4e4768bdaac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1693f4d08b4ad78d900cf8dc096f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:37Z,use_quota=True,user_id='e6fe938caa674be4a40dd6f7b812fe6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191a7e70-5be9-43c3-b35a-06cb930c4e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191a7e70-5be9-43c3-b35a-06cb930c4e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c128cb0-f23d-42c2-8ef5-9c5b720e0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c128cb0-f23d-42c2-8ef5-9c5b720e0beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669b1977-6e58-44b7-8905-4e4768bdaac2', 'volume_name': 'volume-669b1977-6e58-44b7-8905-4e4768bdaac2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b6bbfb-d433-4098-b04d-ce8fb193a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b6bbfb-d433-4098-b04d-ce8fb193a55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e6a4cf-29a0-4dc6-bfca-6fa4ae920c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Volume 669b1977-6e58-44b7-8905-4e4768bdaac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669b1977-6e58-44b7-8905-4e4768bdaac2', 'volume_size': 1}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-865272902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669b1977-6e58-44b7-8905-4e4768bdaac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1693f4d08b4ad78d900cf8dc096f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:37Z,use_quota=True,user_id='e6fe938caa674be4a40dd6f7b812fe6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Creating volume 669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:34:37 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:37 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 1073741824
Nov 06 08:34:37 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:37 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 1073741824" returned: 0 in 0.407s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:37 devstack sudo[105132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2
Nov 06 08:34:37 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:37 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e6a4cf-29a0-4dc6-bfca-6fa4ae920c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669b1977-6e58-44b7-8905-4e4768bdaac2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b1638f-59de-4083-b76a-0df43bb9a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Volume volume-669b1977-6e58-44b7-8905-4e4768bdaac2 (669b1977-6e58-44b7-8905-4e4768bdaac2): created successfully
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b1638f-59de-4083-b76a-0df43bb9a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Flow 'volume_create_manager' (9134bfbb-b194-4671-acbc-763ddba69931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1d2d4303-7715-45f1-9efb-b0e20001da4a tempest-SnapshotMetadataTestJSON-1989389580 None] Created volume successfully.
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Creating offline snapshot ac16a8ea-1401-4431-835d-6fa78a102811 of volume 669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3a93f-d824-4d42-89bd-bcb086e21f5f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:38 devstack sudo[105135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2
Nov 06 08:34:38 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:38 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2" returned: 0 in 0.356s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:38 devstack sudo[105140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 1G
Nov 06 08:34:38 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:39 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 1G" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669b1977-6e58-44b7-8905-4e4768bdaac2 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:39 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669b1977-6e58-44b7-8905-4e4768bdaac2 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811
Nov 06 08:34:39 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:39 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669b1977-6e58-44b7-8905-4e4768bdaac2 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811" returned: 0 in 0.286s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:39 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 is being set with open permissions: ugo+rw
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:39 devstack sudo[105151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811
Nov 06 08:34:39 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:39 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811" returned: 0 in 0.236s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:39 devstack sudo[105154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.info
Nov 06 08:34:39 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:39 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.info" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:39 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.info is being set with open permissions: ugo+rw
Nov 06 08:34:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:39 devstack sudo[105157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.info
Nov 06 08:34:39 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:40 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.info" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:40 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-55386316-c2d7-44cc-aac4-c5f265e17765 tempest-SnapshotMetadataTestJSON-1989389580 None] Create snapshot completed successfully
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "cinder-ac16a8ea-1401-4431-835d-6fa78a102811-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-ac16a8ea-1401-4431-835d-6fa78a102811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "cinder-quobyte-669b1977-6e58-44b7-8905-4e4768bdaac2" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-quobyte-669b1977-6e58-44b7-8905-4e4768bdaac2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "cinder-quobyte-ac16a8ea-1401-4431-835d-6fa78a102811" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-quobyte-ac16a8ea-1401-4431-835d-6fa78a102811" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Deleting offline snapshot ac16a8ea-1401-4431-835d-6fa78a102811 of volume 669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] snapshot_file for this snap is: volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c05e86d-ee97-40c4-a45c-4cc9265dc4f6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:41 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811
Nov 06 08:34:41 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:41 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811" returned: 0 in 0.349s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669b1977-6e58-44b7-8905-4e4768bdaac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdb1cd7-43b2-4b74-91e7-4fe2ecd5e02e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:41 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2
Nov 06 08:34:41 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:41 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2" returned: 0 in 0.343s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:41 devstack sudo[105170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811
Nov 06 08:34:41 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:42 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811" returned: 0 in 0.324s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:42 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811
Nov 06 08:34:42 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:42 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2.ac16a8ea-1401-4431-835d-6fa78a102811" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-quobyte-ac16a8ea-1401-4431-835d-6fa78a102811" released by "_delete_snapshot" :: held 1.358s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-quobyte-669b1977-6e58-44b7-8905-4e4768bdaac2" released by "delete_snapshot" :: held 1.383s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:42 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Created reservations ['055659a9-b1f0-463f-93ae-8f7916f55340', '91396788-00c5-429c-8b50-06fe5f977626', '62a127ea-ef46-4e4b-9f23-f260b7ca9eb5', '565f2457-7580-4dd3-8dcb-156a01cbc497'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Delete snapshot completed successfully.
Nov 06 08:34:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b6c8de7a-764b-43f6-af69-78e315462977 tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-ac16a8ea-1401-4431-835d-6fa78a102811-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "cinder-669b1977-6e58-44b7-8905-4e4768bdaac2-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-669b1977-6e58-44b7-8905-4e4768bdaac2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "cinder-quobyte-669b1977-6e58-44b7-8905-4e4768bdaac2" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-quobyte-669b1977-6e58-44b7-8905-4e4768bdaac2" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfeb40b-7abd-4a30-8646-a518c587c87c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:43 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2
Nov 06 08:34:43 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:43 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:43 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2
Nov 06 08:34:43 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:44 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-669b1977-6e58-44b7-8905-4e4768bdaac2" returned: 0 in 0.236s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-quobyte-669b1977-6e58-44b7-8905-4e4768bdaac2" released by "delete_volume" :: held 0.653s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Created reservations ['980c4e08-cf73-4755-94f4-04f94277be91', '5d3e64b7-35af-4822-b76c-87906b2fed46', 'fdb26b4b-f56b-4617-ace4-7a92fb433645', '727cefaf-14c0-46ae-89fd-ca6b083c628e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:44 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:34:44 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:44 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:34:44 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Deleted volume successfully.
Nov 06 08:34:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-05f723fe-f555-4ae5-91c5-7e7a2dbf89ff tempest-SnapshotMetadataTestJSON-1989389580 None] Lock "cinder-669b1977-6e58-44b7-8905-4e4768bdaac2-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Flow 'volume_create_manager' (5c4b285f-4d52-4020-8181-05f1e072253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1296db62-0d14-4a50-bd78-22662ab786ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1296db62-0d14-4a50-bd78-22662ab786ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-52892111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d522501-ef11-4127-b361-94a158cc0419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d9397114ec4e0a9830aaf0d9e189cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:48Z,use_quota=True,user_id='694b5f0d535d40e8a9dcc3f05475c190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1b7028-006b-4aef-9f8f-4d0fbed20c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1b7028-006b-4aef-9f8f-4d0fbed20c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ff7c1a-8441-4ab8-b12e-4afa399b8394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ff7c1a-8441-4ab8-b12e-4afa399b8394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d522501-ef11-4127-b361-94a158cc0419', 'volume_name': 'volume-5d522501-ef11-4127-b361-94a158cc0419', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53d9d30-942b-4424-aba4-b2d7779d178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53d9d30-942b-4424-aba4-b2d7779d178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58485067-de49-4154-96e1-83778cbea7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:47 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Volume 5d522501-ef11-4127-b361-94a158cc0419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d522501-ef11-4127-b361-94a158cc0419', 'volume_size': 1}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-52892111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d522501-ef11-4127-b361-94a158cc0419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d9397114ec4e0a9830aaf0d9e189cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:48Z,use_quota=True,user_id='694b5f0d535d40e8a9dcc3f05475c190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Creating volume 5d522501-ef11-4127-b361-94a158cc0419 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:34:47 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:34:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:47 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419 1073741824
Nov 06 08:34:47 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:48 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419 1073741824" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:48 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419
Nov 06 08:34:48 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:48 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58485067-de49-4154-96e1-83778cbea7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d522501-ef11-4127-b361-94a158cc0419', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653bf0a5-dcaa-4ef1-b7c2-3bac2a771992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Volume volume-5d522501-ef11-4127-b361-94a158cc0419 (5d522501-ef11-4127-b361-94a158cc0419): created successfully
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653bf0a5-dcaa-4ef1-b7c2-3bac2a771992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Flow 'volume_create_manager' (5c4b285f-4d52-4020-8181-05f1e072253e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-529b228c-668f-4970-b924-be472976f9e5 tempest-VolumesMetadataTest-1036077420 None] Created volume successfully.
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Acquiring lock "cinder-5d522501-ef11-4127-b361-94a158cc0419-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Lock "cinder-5d522501-ef11-4127-b361-94a158cc0419-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Acquiring lock "cinder-quobyte-5d522501-ef11-4127-b361-94a158cc0419" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Lock "cinder-quobyte-5d522501-ef11-4127-b361-94a158cc0419" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c664f5f-c499-4e49-9ba2-3b69421f1807]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:49 devstack sudo[105200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419
Nov 06 08:34:49 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:49 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419" returned: 0 in 0.353s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:49 devstack sudo[105205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419
Nov 06 08:34:49 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:50 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5d522501-ef11-4127-b361-94a158cc0419" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Lock "cinder-quobyte-5d522501-ef11-4127-b361-94a158cc0419" released by "delete_volume" :: held 0.636s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Created reservations ['46bc6a94-ba5c-4f4b-b381-006664666e81', '3ea0d339-8eae-460e-b189-f2a409c26da5', 'e417af2d-cb89-49e9-a196-b7145cadd67d', 'b4697de1-6da9-45a2-81d9-ed12296112dd'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:50 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:34:50 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:50 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:34:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Deleted volume successfully.
Nov 06 08:34:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7a1d2685-6ffd-4015-bd8f-9f3cde1c742f tempest-VolumesMetadataTest-1036077420 None] Lock "cinder-5d522501-ef11-4127-b361-94a158cc0419-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Flow 'volume_create_manager' (21170647-d01d-4368-9917-f5cd401536d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c11b9d-ea5f-4a4d-a27e-d5f8950436b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c11b9d-ea5f-4a4d-a27e-d5f8950436b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-287813702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a206deb8-6ea8-4d55-b083-f5b4bfea1cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78be1a5dffde414a81039f9a7e60ae62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:55Z,use_quota=True,user_id='55b9aef941f74de588c543ccba8ba7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00c7407-9b92-46b6-a60b-bcfc9998fc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00c7407-9b92-46b6-a60b-bcfc9998fc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ed8fa7-1549-4b86-9309-19e87adcfc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ed8fa7-1549-4b86-9309-19e87adcfc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a206deb8-6ea8-4d55-b083-f5b4bfea1cc3', 'volume_name': 'volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0988607-3e1d-4a64-a91f-83b86b056dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0988607-3e1d-4a64-a91f-83b86b056dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d4c2cc-ae95-412d-8fc8-0b16a443e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:55 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Volume a206deb8-6ea8-4d55-b083-f5b4bfea1cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3', 'volume_size': 1}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-287813702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a206deb8-6ea8-4d55-b083-f5b4bfea1cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78be1a5dffde414a81039f9a7e60ae62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:55Z,use_quota=True,user_id='55b9aef941f74de588c543ccba8ba7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Creating volume a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:34:55 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:55 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 1073741824
Nov 06 08:34:55 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:55 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 1073741824" returned: 0 in 0.401s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:55 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3
Nov 06 08:34:55 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:55 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3" returned: 0 in 0.248s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d4c2cc-ae95-412d-8fc8-0b16a443e11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b71ee9-1395-40b2-a6cd-fa489c8ee25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:55 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Volume volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 (a206deb8-6ea8-4d55-b083-f5b4bfea1cc3): created successfully
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b71ee9-1395-40b2-a6cd-fa489c8ee25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Flow 'volume_create_manager' (21170647-d01d-4368-9917-f5cd401536d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c11c1165-59e6-4040-b869-2af15f0836b1 tempest-VolumesTransfersV355Test-446790417 None] Created volume successfully.
Nov 06 08:34:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-090f5bbe-82a8-42fe-8a71-cf21ebd84025 tempest-VolumesTransfersV355Test-65154310 None] Transfer volume completed successfully.
Nov 06 08:34:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Acquiring lock "cinder-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Acquiring lock "cinder-quobyte-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-quobyte-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce72e13c-49e0-4448-9048-29376b4b1b92]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:57 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3
Nov 06 08:34:57 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:57 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3" returned: 0 in 0.356s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:57 devstack sudo[105225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3
Nov 06 08:34:57 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:57 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-quobyte-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3" released by "delete_volume" :: held 0.632s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Created reservations ['caf7fa1a-d9cd-46ea-ad10-3fe14fafedba', 'c48bf65b-2b63-454e-93c0-613d5729e08f', '9e8a9ab8-40bf-4e1e-b0bd-7b3bcb686050', '9f8e56c6-bac8-4f24-bc22-9372d7b99b6c'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:57 devstack sudo[105228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:34:57 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:58 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:34:58 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Deleted volume successfully.
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-d96d15ee-dc48-4afd-98a4-6e8a9248c0bb tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-a206deb8-6ea8-4d55-b083-f5b4bfea1cc3-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Flow 'volume_create_manager' (76cc3416-c8a3-4d3b-a73f-5992dc3abc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91043b2e-ad6b-4fc7-b941-28a8d935d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91043b2e-ad6b-4fc7-b941-28a8d935d759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-956178903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d007f020-6378-4df3-b81a-7bb7c274f718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78be1a5dffde414a81039f9a7e60ae62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:59Z,use_quota=True,user_id='55b9aef941f74de588c543ccba8ba7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76143a02-c58c-41f8-9e38-09dd927afdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76143a02-c58c-41f8-9e38-09dd927afdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e94af-53aa-40b7-b152-83dd97e7da02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e94af-53aa-40b7-b152-83dd97e7da02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd007f020-6378-4df3-b81a-7bb7c274f718', 'volume_name': 'volume-d007f020-6378-4df3-b81a-7bb7c274f718', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c124615-bf03-4e56-a673-4832967aa282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c124615-bf03-4e56-a673-4832967aa282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6e5b65-015d-4a68-af94-3a463fb7f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:58 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Volume d007f020-6378-4df3-b81a-7bb7c274f718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d007f020-6378-4df3-b81a-7bb7c274f718', 'volume_size': 1}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-956178903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d007f020-6378-4df3-b81a-7bb7c274f718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78be1a5dffde414a81039f9a7e60ae62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:34:59Z,use_quota=True,user_id='55b9aef941f74de588c543ccba8ba7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Creating volume d007f020-6378-4df3-b81a-7bb7c274f718 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:34:58 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:34:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:58 devstack sudo[105231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718 1073741824
Nov 06 08:34:58 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:59 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718 1073741824" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:34:59 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718
Nov 06 08:34:59 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:34:59 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6e5b65-015d-4a68-af94-3a463fb7f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d007f020-6378-4df3-b81a-7bb7c274f718', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38cbb27-2bbd-42b2-a50c-e7145ff046e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:34:59 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Volume volume-d007f020-6378-4df3-b81a-7bb7c274f718 (d007f020-6378-4df3-b81a-7bb7c274f718): created successfully
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38cbb27-2bbd-42b2-a50c-e7145ff046e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Flow 'volume_create_manager' (76cc3416-c8a3-4d3b-a73f-5992dc3abc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:34:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f4892c70-9618-446e-83ca-cd2176f79284 tempest-VolumesTransfersV355Test-446790417 None] Created volume successfully.
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Acquiring lock "cinder-d007f020-6378-4df3-b81a-7bb7c274f718-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-d007f020-6378-4df3-b81a-7bb7c274f718-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Acquiring lock "cinder-quobyte-d007f020-6378-4df3-b81a-7bb7c274f718" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-quobyte-d007f020-6378-4df3-b81a-7bb7c274f718" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[591b281e-86f5-4280-aa72-9ff2e090dcb6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:34:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:00 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718
Nov 06 08:35:00 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:00 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:00 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718
Nov 06 08:35:00 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:00 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d007f020-6378-4df3-b81a-7bb7c274f718" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-quobyte-d007f020-6378-4df3-b81a-7bb7c274f718" released by "delete_volume" :: held 0.643s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Created reservations ['c6972697-208c-4342-bdd6-aa99d8b20264', '8c62c294-e65a-4230-902f-53c3c6de000f', 'a57773fb-d231-41ca-96e0-380d83e1e4ab', '1eb730f8-d443-49dd-89be-f2159993f4c1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:00 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:35:00 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:00 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:35:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Deleted volume successfully.
Nov 06 08:35:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-dd069649-b314-4387-a7c5-b04cf00b3d1c tempest-VolumesTransfersV355Test-1866481397 None] Lock "cinder-d007f020-6378-4df3-b81a-7bb7c274f718-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:35:10 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=44,cinder:INSERT=11,cinder:UPDATE=54,cinder:DELETE=4 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:35:10 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=48,cinder:SELECT=31,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Flow 'volume_create_manager' (e87cb7a4-d09c-44e0-8616-07d22b556472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c907c9-3e61-4202-a919-a32beabefb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c907c9-3e61-4202-a919-a32beabefb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1857493172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb08086-41bb-4167-8f56-a53805a1df5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2b928b66224d49bebda38fe16020f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:35:15Z,use_quota=True,user_id='09684523f5bf44e7ba07628c6938337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c6b45d-e2d9-4ea3-999d-760de4f144f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c6b45d-e2d9-4ea3-999d-760de4f144f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1781c458-050f-466d-aaf7-a51e83851213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1781c458-050f-466d-aaf7-a51e83851213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb08086-41bb-4167-8f56-a53805a1df5e', 'volume_name': 'volume-8fb08086-41bb-4167-8f56-a53805a1df5e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031b2ce9-f741-4320-8b7c-1c6b73b5b276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031b2ce9-f741-4320-8b7c-1c6b73b5b276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa47873d-ac1c-4ab3-9faf-966571008243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:35:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Volume 8fb08086-41bb-4167-8f56-a53805a1df5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb08086-41bb-4167-8f56-a53805a1df5e', 'volume_size': 1}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1857493172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb08086-41bb-4167-8f56-a53805a1df5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2b928b66224d49bebda38fe16020f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:35:15Z,use_quota=True,user_id='09684523f5bf44e7ba07628c6938337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Creating volume 8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:35:15 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:15 devstack sudo[105299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e 1073741824
Nov 06 08:35:15 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:15 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e 1073741824" returned: 0 in 0.403s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:16 devstack sudo[105305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:35:16 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:16 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:35:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:35:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa47873d-ac1c-4ab3-9faf-966571008243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb08086-41bb-4167-8f56-a53805a1df5e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:35:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507bec94-7d42-4241-8b71-de107738f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:35:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Volume volume-8fb08086-41bb-4167-8f56-a53805a1df5e (8fb08086-41bb-4167-8f56-a53805a1df5e): created successfully
Nov 06 08:35:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507bec94-7d42-4241-8b71-de107738f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:35:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Flow 'volume_create_manager' (e87cb7a4-d09c-44e0-8616-07d22b556472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:35:16 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f9927bc2-31a6-4587-b613-dbfb50f66726 tempest-VolumesActionsTest-1849468206 None] Created volume successfully.
Nov 06 08:35:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f4ce879-e50c-4061-b42b-804e9f8eb428 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e" by "attach_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:35:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f4ce879-e50c-4061-b42b-804e9f8eb428 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e" acquired by "attach_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:35:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3f4ce879-e50c-4061-b42b-804e9f8eb428 tempest-VolumesActionsTest-1849468206 None] Attaching volume 8fb08086-41bb-4167-8f56-a53805a1df5e to instance eb18c5ab-2f0d-47d7-b12a-12b5d6e3ecb6 at mountpoint /dev/vdb on host None.
Nov 06 08:35:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3f4ce879-e50c-4061-b42b-804e9f8eb428 tempest-VolumesActionsTest-1849468206 None] Attach volume completed successfully.
Nov 06 08:35:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3f4ce879-e50c-4061-b42b-804e9f8eb428 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e" released by "attach_volume" :: held 0.089s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:35:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46e05b7e-75b8-4367-8d47-4e03acd76d0c tempest-VolumesActionsTest-1849468206 None] Acquiring lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-detach_volume" by "detach_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:35:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46e05b7e-75b8-4367-8d47-4e03acd76d0c tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:35:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-46e05b7e-75b8-4367-8d47-4e03acd76d0c tempest-VolumesActionsTest-1849468206 None] Detaching volume 8fb08086-41bb-4167-8f56-a53805a1df5e from instance eb18c5ab-2f0d-47d7-b12a-12b5d6e3ecb6.
Nov 06 08:35:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-46e05b7e-75b8-4367-8d47-4e03acd76d0c tempest-VolumesActionsTest-1849468206 None] Detach volume completed successfully.
Nov 06 08:35:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46e05b7e-75b8-4367-8d47-4e03acd76d0c tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:30 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:35:30 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:30 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.469s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:35:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:35:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c87db13a-952f-4bb4-9603-f238f4c4f5f6 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e" by "attach_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:35:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c87db13a-952f-4bb4-9603-f238f4c4f5f6 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e" acquired by "attach_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:35:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c87db13a-952f-4bb4-9603-f238f4c4f5f6 tempest-VolumesActionsTest-1849468206 None] Attaching volume 8fb08086-41bb-4167-8f56-a53805a1df5e to instance 6494ed46-6aa9-4304-9a81-4027983e9e16 at mountpoint /dev/vdb on host None.
Nov 06 08:35:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c87db13a-952f-4bb4-9603-f238f4c4f5f6 tempest-VolumesActionsTest-1849468206 None] Attach volume completed successfully.
Nov 06 08:35:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-c87db13a-952f-4bb4-9603-f238f4c4f5f6 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e" released by "attach_volume" :: held 0.129s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:35:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7744dcb4-8a96-4695-a639-96dd7f2491ce tempest-VolumesActionsTest-1849468206 None] Acquiring lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-detach_volume" by "detach_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:35:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7744dcb4-8a96-4695-a639-96dd7f2491ce tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:35:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7744dcb4-8a96-4695-a639-96dd7f2491ce tempest-VolumesActionsTest-1849468206 None] Detaching volume 8fb08086-41bb-4167-8f56-a53805a1df5e from instance 6494ed46-6aa9-4304-9a81-4027983e9e16.
Nov 06 08:35:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7744dcb4-8a96-4695-a639-96dd7f2491ce tempest-VolumesActionsTest-1849468206 None] Detach volume completed successfully.
Nov 06 08:35:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7744dcb4-8a96-4695-a639-96dd7f2491ce tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04a7011-7686-40db-9248-d6e7d2fd8aaf]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:38 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:35:38 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:38 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[05edc1d6-bbc8-4058-8bd9-8d80c7407093]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:38 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:35:38 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:38 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.369s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.f71a9fe1-7972-4862-9e13-171363bc02d5o3ste5qv.img {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:38 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.f71a9fe1-7972-4862-9e13-171363bc02d5o3ste5qv.img
Nov 06 08:35:38 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:44 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:35:44 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.f71a9fe1-7972-4862-9e13-171363bc02d5o3ste5qv.img" returned: 0 in 5.644s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d109950-3571-402a-8b51-a3565f70b6a3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:35:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:35:44 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:35:44 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:35:45 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Nov 06 08:35:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.521s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:35:45 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.f71a9fe1-7972-4862-9e13-171363bc02d5o3ste5qv.img {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:35:45 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Converted 1024.00 MB image at 181.41 MB/s
Nov 06 08:35:45 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] f71a9fe1-7972-4862-9e13-171363bc02d5 was raw, no need to convert to raw {{(pid=87143) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 06 08:35:55 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:35:55 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:36:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.971s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:03 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Uploaded volume to glance image-id: f71a9fe1-7972-4862-9e13-171363bc02d5. {{(pid=87143) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 08:36:03 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f3b64f84-59d1-41cd-ba2f-8b86f99e4e19 tempest-VolumesActionsTest-1849468206 None] Copy volume to image completed successfully.
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e3def-c40a-4c34-bb8d-c45b90aac6f3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:05 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:36:05 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:05 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.356s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd3ec47-7d2d-4f64-9bb8-f8b6cb2e3fc8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:05 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:36:05 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:05 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.342s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:05 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img
Nov 06 08:36:05 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:11 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img" returned: 0 in 5.567s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:11 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d29266-0a5f-469f-b08a-55d63d49fb69]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:11 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:36:11 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:11 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.512s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:11 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:36:11 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Converted 1024.00 MB image at 183.89 MB/s
Nov 06 08:36:11 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] 4091fa9b-4f65-4b82-8250-945c04ac807e was raw, converting to qcow2 {{(pid=87143) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[395a7bbf-a3aa-49ee-8301-24b9c6cd94b2]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:12 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img
Nov 06 08:36:12 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:12 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img" returned: 0 in 0.311s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:12 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img
Nov 06 08:36:12 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:12 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img" returned: 1 in 0.313s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img /opt/stack/data/cinder/conversion/vol_upload_c2xf8vmq {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:12 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img /opt/stack/data/cinder/conversion/vol_upload_c2xf8vmq
Nov 06 08:36:12 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:12 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img /opt/stack/data/cinder/conversion/vol_upload_c2xf8vmq" returned: 0 in 0.251s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Image conversion details: src /opt/stack/data/cinder/conversion/8fb08086-41bb-4167-8f56-a53805a1df5e.temp_image.4091fa9b-4f65-4b82-8250-945c04ac807epc_grb15.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_c2xf8vmq {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:36:12 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c485ee58-40c0-43bc-a12d-edc7c09765a4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c2xf8vmq {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:12 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c2xf8vmq
Nov 06 08:36:12 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:13 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c2xf8vmq" returned: 0 in 0.317s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.201s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Uploaded volume to glance image-id: 4091fa9b-4f65-4b82-8250-945c04ac807e. {{(pid=87143) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 08:36:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b6374a4a-bc33-4d00-8c67-7762fcd91eb7 tempest-VolumesActionsTest-1849468206 None] Copy volume to image completed successfully.
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "cinder-quobyte-8fb08086-41bb-4167-8f56-a53805a1df5e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-quobyte-8fb08086-41bb-4167-8f56-a53805a1df5e" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[924bbc92-ca05-43ef-889a-6d26f88bd679]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:15 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:36:15 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:15 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.349s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:15 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e
Nov 06 08:36:15 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:15 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8fb08086-41bb-4167-8f56-a53805a1df5e" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-quobyte-8fb08086-41bb-4167-8f56-a53805a1df5e" released by "delete_volume" :: held 0.634s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Created reservations ['1a1e97aa-8f0b-4d9d-877a-d64c82f709fc', 'f1aff89a-79cd-4e65-9547-1ae37184b463', '3971436d-fa1b-4f72-8a34-246ad7610ec4', '8d4f24ad-0206-48ae-8a42-c25f2d70317f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:15 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:36:15 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:16 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.251s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:16 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:36:16 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Deleted volume successfully.
Nov 06 08:36:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-46073a5b-4580-4278-a740-a513238ec405 tempest-VolumesActionsTest-1849468206 None] Lock "cinder-8fb08086-41bb-4167-8f56-a53805a1df5e-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:22 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:36:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Flow 'volume_create_manager' (1e0168f8-9d41-4a20-854c-24254148e823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d967bf1-92f0-4d38-96b8-7dfdd91969c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d967bf1-92f0-4d38-96b8-7dfdd91969c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1895070872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9eaf01eb2c45eb9f874effd8c765ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:23Z,use_quota=True,user_id='127b2527159944a7857b7b0a66b4c7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2952a4-3224-4ff0-89e2-30d55d18f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2952a4-3224-4ff0-89e2-30d55d18f659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8109e1de-c400-49f7-85d0-2e6d80e33d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8109e1de-c400-49f7-85d0-2e6d80e33d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3', 'volume_name': 'volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3', 'volume_size': 2}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dc8f55-54c9-4a80-bf97-00cea0127b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dc8f55-54c9-4a80-bf97-00cea0127b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33010a34-6918-4476-b40a-7cf63cca1e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Volume 98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3', 'volume_size': 2}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1895070872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9eaf01eb2c45eb9f874effd8c765ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:23Z,use_quota=True,user_id='127b2527159944a7857b7b0a66b4c7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Creating volume 98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:36:23 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 2147483648 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:23 devstack sudo[105682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 2147483648
Nov 06 08:36:23 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:23 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 2147483648" returned: 0 in 0.466s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:23 devstack sudo[105687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3
Nov 06 08:36:23 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:23 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33010a34-6918-4476-b40a-7cf63cca1e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3', 'volume_size': 2}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f928390c-7204-48aa-b4d5-9e19871a8e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:23 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Volume volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 (98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3): created successfully
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f928390c-7204-48aa-b4d5-9e19871a8e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:23 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Flow 'volume_create_manager' (1e0168f8-9d41-4a20-854c-24254148e823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ffbf1c9e-bb7a-4304-85d0-fdaf1321f6c4 tempest-VolumesCloneNegativeTest-570972242 None] Created volume successfully.
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Acquiring lock "cinder-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Lock "cinder-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Acquiring lock "cinder-quobyte-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Lock "cinder-quobyte-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baaa467-923a-4cc1-9bfe-21152a5dac32]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:24 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3
Nov 06 08:36:24 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:24 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:24 devstack sudo[105695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3
Nov 06 08:36:24 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:24 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Lock "cinder-quobyte-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3" released by "delete_volume" :: held 0.636s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Created reservations ['651b47aa-b98f-4aaf-b735-792820060e67', '92f8f7bb-7fe2-442d-8834-dbc426d42e37', '213f8d14-d900-4f0b-acd7-1f0c685ad2b3', 'ad5399f7-2746-4f0d-a543-515a95975ea1'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:24 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:36:24 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:25 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.262s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:25 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:36:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Deleted volume successfully.
Nov 06 08:36:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-620515b0-3e1d-4d84-93d8-6a9686d4cca2 tempest-VolumesCloneNegativeTest-570972242 None] Lock "cinder-98ae3aa0-dfb2-4aa9-8884-16d3bbce86b3-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:30 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:36:30 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:30 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:36:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Flow 'volume_create_manager' (fa5cf45f-0cbf-4d88-8e2a-e6eb2a197c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715fbac2-feb2-4c57-9606-a700828efc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715fbac2-feb2-4c57-9606-a700828efc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1832833300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfc6999-f387-4f87-a5bd-1546c2bfa7bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0fc23f8d2453f9657600e2aa4df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:31Z,use_quota=True,user_id='58c31acab7af4378b9e7a30e9c3e1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a133061-0112-443f-9013-d868e009363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a133061-0112-443f-9013-d868e009363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e90e84a-2f43-4629-bef4-206dc04ae186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e90e84a-2f43-4629-bef4-206dc04ae186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bfc6999-f387-4f87-a5bd-1546c2bfa7bd', 'volume_name': 'volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d66c5d-0af3-43e9-926a-6e09bc57b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d66c5d-0af3-43e9-926a-6e09bc57b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0041ca97-c893-404f-91a8-119512f183d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:31 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Volume 4bfc6999-f387-4f87-a5bd-1546c2bfa7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd', 'volume_size': 1}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1832833300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfc6999-f387-4f87-a5bd-1546c2bfa7bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0fc23f8d2453f9657600e2aa4df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:31Z,use_quota=True,user_id='58c31acab7af4378b9e7a30e9c3e1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:36:31 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd 1073741824
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Creating volume 4bfc6999-f387-4f87-a5bd-1546c2bfa7bd {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:36:31 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:31 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:31 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd 1073741824" returned: 0 in 0.409s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:32 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd
Nov 06 08:36:32 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:32 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0041ca97-c893-404f-91a8-119512f183d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b07593e-b12f-49a6-aca6-b333eda4bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:32 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Volume volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd (4bfc6999-f387-4f87-a5bd-1546c2bfa7bd): created successfully
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b07593e-b12f-49a6-aca6-b333eda4bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Flow 'volume_create_manager' (fa5cf45f-0cbf-4d88-8e2a-e6eb2a197c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:32 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ec648b20-b1f2-40b9-a823-a1cc6c89caf5 tempest-VolumesListTestJSON-1982679527 None] Created volume successfully.
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Flow 'volume_create_manager' (d04844f3-71c9-4ce8-a3d1-2f21a44ad76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f016fac7-a94d-41ff-afe7-8b1dc41944de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f016fac7-a94d-41ff-afe7-8b1dc41944de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-550494600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc6b468-01bb-4635-8b8b-4dea8cca3f5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0fc23f8d2453f9657600e2aa4df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:33Z,use_quota=True,user_id='58c31acab7af4378b9e7a30e9c3e1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b825a06-2488-4797-aeed-57d9d8bb57a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b825a06-2488-4797-aeed-57d9d8bb57a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4346d116-d6e4-4ee0-9c2b-3910013d245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4346d116-d6e4-4ee0-9c2b-3910013d245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc6b468-01bb-4635-8b8b-4dea8cca3f5b', 'volume_name': 'volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e6f03a-8fa5-4305-b06a-8e4f413c2a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e6f03a-8fa5-4305-b06a-8e4f413c2a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8764d7-4457-4530-97d7-46f8c4ba2b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:33 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Volume 4bc6b468-01bb-4635-8b8b-4dea8cca3f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b', 'volume_size': 1}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-550494600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc6b468-01bb-4635-8b8b-4dea8cca3f5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0fc23f8d2453f9657600e2aa4df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:33Z,use_quota=True,user_id='58c31acab7af4378b9e7a30e9c3e1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Creating volume 4bc6b468-01bb-4635-8b8b-4dea8cca3f5b {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:36:33 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:33 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b 1073741824
Nov 06 08:36:33 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:33 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b 1073741824" returned: 0 in 0.400s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:33 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b
Nov 06 08:36:33 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:33 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8764d7-4457-4530-97d7-46f8c4ba2b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934bb22b-8013-41ca-9a8c-51681fd8b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:33 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Volume volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b (4bc6b468-01bb-4635-8b8b-4dea8cca3f5b): created successfully
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934bb22b-8013-41ca-9a8c-51681fd8b53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Flow 'volume_create_manager' (d04844f3-71c9-4ce8-a3d1-2f21a44ad76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f8ec16d0-fc1b-4039-8096-7498a1ff9677 tempest-VolumesListTestJSON-1982679527 None] Created volume successfully.
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Flow 'volume_create_manager' (39c2ebb7-92c2-4839-9f73-ddd095917873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c510f35-326b-407a-ab4b-aac2eac632f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c510f35-326b-407a-ab4b-aac2eac632f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1129793311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4831ae-23b6-4e27-b4fe-65dda7fa615f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0fc23f8d2453f9657600e2aa4df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:34Z,use_quota=True,user_id='58c31acab7af4378b9e7a30e9c3e1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72eb2ce4-3191-4fb3-93fe-0780740733bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72eb2ce4-3191-4fb3-93fe-0780740733bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b777ad25-6e3f-4dc1-b002-875e96c51bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b777ad25-6e3f-4dc1-b002-875e96c51bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4831ae-23b6-4e27-b4fe-65dda7fa615f', 'volume_name': 'volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0f52d5-fee3-4359-8003-d87e89fcc8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0f52d5-fee3-4359-8003-d87e89fcc8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27113ebd-fea1-4cd0-85bc-7dc7b8112c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Volume 1f4831ae-23b6-4e27-b4fe-65dda7fa615f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f', 'volume_size': 1}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1129793311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4831ae-23b6-4e27-b4fe-65dda7fa615f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0fc23f8d2453f9657600e2aa4df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:36:34Z,use_quota=True,user_id='58c31acab7af4378b9e7a30e9c3e1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Creating volume 1f4831ae-23b6-4e27-b4fe-65dda7fa615f {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:36:34 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:34 devstack sudo[105726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f 1073741824
Nov 06 08:36:34 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:34 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f 1073741824" returned: 0 in 0.410s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:34 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f
Nov 06 08:36:34 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:35 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f" returned: 0 in 0.234s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:36:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27113ebd-fea1-4cd0-85bc-7dc7b8112c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466217cb-2e27-4716-93c9-d633ee20f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:36:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Volume volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f (1f4831ae-23b6-4e27-b4fe-65dda7fa615f): created successfully
Nov 06 08:36:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466217cb-2e27-4716-93c9-d633ee20f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:36:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Flow 'volume_create_manager' (39c2ebb7-92c2-4839-9f73-ddd095917873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:36:35 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1689e787-7670-44e0-8a91-6a401471dd68 tempest-VolumesListTestJSON-1982679527 None] Created volume successfully.
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "cinder-1f4831ae-23b6-4e27-b4fe-65dda7fa615f-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-1f4831ae-23b6-4e27-b4fe-65dda7fa615f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "cinder-quobyte-1f4831ae-23b6-4e27-b4fe-65dda7fa615f" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-quobyte-1f4831ae-23b6-4e27-b4fe-65dda7fa615f" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2938635a-3d0f-4eb6-a678-69595a59c0b2]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:37 devstack sudo[105736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f
Nov 06 08:36:37 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:37 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f" returned: 0 in 0.353s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:37 devstack sudo[105741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f
Nov 06 08:36:37 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:37 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1f4831ae-23b6-4e27-b4fe-65dda7fa615f" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-quobyte-1f4831ae-23b6-4e27-b4fe-65dda7fa615f" released by "delete_volume" :: held 0.635s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:37 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Created reservations ['05e2aade-c891-4a2a-88be-f5b15040bcaa', 'd58a5bde-f005-48c7-982b-06eb5750d26f', '3f5898f0-09f3-49c0-8de4-e083c7bde0fa', 'decaad66-7d65-4eb8-bef2-85d536d960ec'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:38 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:36:38 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:38 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:36:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Deleted volume successfully.
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fc6a80be-1529-43f6-b700-721d568be4f0 tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-1f4831ae-23b6-4e27-b4fe-65dda7fa615f-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "cinder-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "cinder-quobyte-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-quobyte-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eeed67-0566-4c50-a770-d62c8e0c5b15]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:38 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b
Nov 06 08:36:38 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:38 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:38 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b
Nov 06 08:36:38 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:39 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-quobyte-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b" released by "delete_volume" :: held 0.635s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Created reservations ['45ff6f22-c375-4d9d-802a-00f00428975e', 'b0c23942-cb30-426c-86cc-e0722f3a5a0f', 'f91bb27b-5ce1-4984-89b6-02479e0b68b5', '32a5920b-a474-4ed6-8dcd-886e2276f707'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:39 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:36:39 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:39 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:36:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Deleted volume successfully.
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e68c0a51-3d71-43de-9be9-56e7864b89ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-4bc6b468-01bb-4635-8b8b-4dea8cca3f5b-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "cinder-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "cinder-quobyte-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-quobyte-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b31a1-edfa-4a4a-aca7-06a7ff61b571]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:36:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:40 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd
Nov 06 08:36:40 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:40 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd" returned: 0 in 0.350s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:40 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd
Nov 06 08:36:40 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:40 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-quobyte-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd" released by "delete_volume" :: held 0.629s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Created reservations ['c8be4606-3454-4dfa-aabb-6d2cda1a784f', '1c008439-be43-496d-a2cd-b71461160c70', 'af3c3aa2-d1f7-49d9-8112-fbaf97fb88c6', '96795133-ddbf-47ad-bf95-70974ed16787'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:36:40 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:36:40 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:36:40 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:36:40 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Deleted volume successfully.
Nov 06 08:36:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7b7f549d-d603-4f30-89d7-df3d9f0f95ab tempest-VolumesListTestJSON-1982679527 None] Lock "cinder-4bfc6999-f387-4f87-a5bd-1546c2bfa7bd-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:36:50 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=35,cinder:UPDATE=52,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:36:50 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=55,cinder:SELECT=37,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Flow 'volume_create_manager' (910aa0f6-73eb-414c-88bf-73859f9db810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2222da7-f3c5-4a70-ada9-3924b1af9805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2222da7-f3c5-4a70-ada9-3924b1af9805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2092583082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201b7f94-f886-465f-a2ed-0f5adc4ff15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c3cf7c9048409fbdf16a23090e6d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:37:01Z,use_quota=True,user_id='4b0f30dd503c4fffb592a2aa67210c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e24965-9e68-42e1-8a8b-bbbba940f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e24965-9e68-42e1-8a8b-bbbba940f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c659b9c-bbe5-4434-ac63-dad5b677883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c659b9c-bbe5-4434-ac63-dad5b677883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201b7f94-f886-465f-a2ed-0f5adc4ff15e', 'volume_name': 'volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def67dbe-08de-422f-9810-be2b13972b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def67dbe-08de-422f-9810-be2b13972b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ce440c-6b8e-4bc3-9dc8-a3c07056368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Volume 201b7f94-f886-465f-a2ed-0f5adc4ff15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e', 'volume_size': 1}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2092583082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201b7f94-f886-465f-a2ed-0f5adc4ff15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c3cf7c9048409fbdf16a23090e6d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:37:01Z,use_quota=True,user_id='4b0f30dd503c4fffb592a2aa67210c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Creating volume 201b7f94-f886-465f-a2ed-0f5adc4ff15e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:37:01 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:01 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e 1073741824
Nov 06 08:37:01 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Flow 'volume_create_manager' (e6698d52-9540-4e85-9aa0-72226f681a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704652b9-78e2-4d90-8cf6-3cbb843c08f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704652b9-78e2-4d90-8cf6-3cbb843c08f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1601957324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73ebbe7-c2eb-44b1-b542-47910a1212bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c3cf7c9048409fbdf16a23090e6d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:37:01Z,use_quota=True,user_id='4b0f30dd503c4fffb592a2aa67210c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00debfe7-dc31-49a3-864d-25d20351b76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00debfe7-dc31-49a3-864d-25d20351b76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfc0d02-903a-422f-944d-e8c4dd35beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfc0d02-903a-422f-944d-e8c4dd35beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a73ebbe7-c2eb-44b1-b542-47910a1212bb', 'volume_name': 'volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3efd9a2-6334-42da-b09d-1ff1bbeba39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3efd9a2-6334-42da-b09d-1ff1bbeba39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30cc9e0-2539-4386-8c53-d84ef924ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Volume a73ebbe7-c2eb-44b1-b542-47910a1212bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb', 'volume_size': 1}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:01 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e 1073741824" returned: 0 in 0.511s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:01 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e
Nov 06 08:37:01 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:01 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e" returned: 0 in 0.253s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1601957324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73ebbe7-c2eb-44b1-b542-47910a1212bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c3cf7c9048409fbdf16a23090e6d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:37:01Z,use_quota=True,user_id='4b0f30dd503c4fffb592a2aa67210c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Creating volume a73ebbe7-c2eb-44b1-b542-47910a1212bb {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:37:01 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ce440c-6b8e-4bc3-9dc8-a3c07056368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb 1073741824
Nov 06 08:37:01 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67dc41e-8252-4489-9a17-6fe34c335cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:01 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Volume volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e (201b7f94-f886-465f-a2ed-0f5adc4ff15e): created successfully
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67dc41e-8252-4489-9a17-6fe34c335cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Flow 'volume_create_manager' (910aa0f6-73eb-414c-88bf-73859f9db810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:37:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cafc8d2c-1996-4988-8463-dd91d64b3cff tempest-TestServerVolumeAttachmentScenario-291228449 None] Created volume successfully.
Nov 06 08:37:02 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb 1073741824" returned: 0 in 0.474s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:02 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb
Nov 06 08:37:02 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:02 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30cc9e0-2539-4386-8c53-d84ef924ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b28b51b-bd87-40f0-927c-680cd38786fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:02 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Volume volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb (a73ebbe7-c2eb-44b1-b542-47910a1212bb): created successfully
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b28b51b-bd87-40f0-927c-680cd38786fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:02 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Flow 'volume_create_manager' (e6698d52-9540-4e85-9aa0-72226f681a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:37:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a6687a57-fbc3-44fd-af8a-44cfdbffad4c tempest-TestServerVolumeAttachmentScenario-291228449 None] Created volume successfully.
Nov 06 08:37:12 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:37:12 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:37:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:37:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:37:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:37:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-3988a6a3-5573-4d0a-a0f8-5dc3a2b34e80 req-5181568c-1e0d-49a4-a9bc-362fdd040bf7 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-3988a6a3-5573-4d0a-a0f8-5dc3a2b34e80 req-5181568c-1e0d-49a4-a9bc-362fdd040bf7 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-3988a6a3-5573-4d0a-a0f8-5dc3a2b34e80 req-5181568c-1e0d-49a4-a9bc-362fdd040bf7 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-3988a6a3-5573-4d0a-a0f8-5dc3a2b34e80 req-5181568c-1e0d-49a4-a9bc-362fdd040bf7 tempest-TestServerVolumeAttachmentScenario-291228449 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93482d07-9639-4326-803a-55ea9e3342ab', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:37:32 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-3988a6a3-5573-4d0a-a0f8-5dc3a2b34e80 req-5181568c-1e0d-49a4-a9bc-362fdd040bf7 tempest-TestServerVolumeAttachmentScenario-291228449 None] attachment_update completed successfully.
Nov 06 08:37:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-2903c80f-7ce1-4350-919e-b150745f2ccb req-6406312c-9839-4e61-ab2d-7393973fedf3 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-2903c80f-7ce1-4350-919e-b150745f2ccb req-6406312c-9839-4e61-ab2d-7393973fedf3 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [req-2903c80f-7ce1-4350-919e-b150745f2ccb req-6406312c-9839-4e61-ab2d-7393973fedf3 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-2903c80f-7ce1-4350-919e-b150745f2ccb req-6406312c-9839-4e61-ab2d-7393973fedf3 tempest-TestServerVolumeAttachmentScenario-291228449 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee', 'name': 'volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78aad2f1-5fac-4aca-893b-eabda85fd08e', 'enforce_multipath': True} {{(pid=87143) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 08:37:37 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-2903c80f-7ce1-4350-919e-b150745f2ccb req-6406312c-9839-4e61-ab2d-7393973fedf3 tempest-TestServerVolumeAttachmentScenario-291228449 None] attachment_update completed successfully.
Nov 06 08:37:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-6044bfcd-4e5b-40fb-af29-a689bb40e209 req-088aa134-958e-4242-9217-0717931daae9 tempest-TestServerVolumeAttachmentScenario-291228449 None] Terminate volume connection completed successfully.
Nov 06 08:37:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-6044bfcd-4e5b-40fb-af29-a689bb40e209 req-088aa134-958e-4242-9217-0717931daae9 tempest-TestServerVolumeAttachmentScenario-291228449 None] Deleting attachment 78aad2f1-5fac-4aca-893b-eabda85fd08e. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:37:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [req-6ff5edd4-8b62-42ee-b033-552907ace0f5 req-fb6c6b04-65e5-4850-b0ed-ca280df25b42 tempest-TestServerVolumeAttachmentScenario-291228449 None] Terminate volume connection completed successfully.
Nov 06 08:37:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [req-6ff5edd4-8b62-42ee-b033-552907ace0f5 req-fb6c6b04-65e5-4850-b0ed-ca280df25b42 tempest-TestServerVolumeAttachmentScenario-291228449 None] Deleting attachment 93482d07-9639-4326-803a-55ea9e3342ab. {{(pid=87143) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "cinder-a73ebbe7-c2eb-44b1-b542-47910a1212bb-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-a73ebbe7-c2eb-44b1-b542-47910a1212bb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "cinder-quobyte-a73ebbe7-c2eb-44b1-b542-47910a1212bb" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-quobyte-a73ebbe7-c2eb-44b1-b542-47910a1212bb" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c75aeb4-149f-4d99-bcce-b79bb3febfaf]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:44 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb
Nov 06 08:37:44 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:44 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb" returned: 0 in 0.362s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:44 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb
Nov 06 08:37:44 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:44 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a73ebbe7-c2eb-44b1-b542-47910a1212bb" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-quobyte-a73ebbe7-c2eb-44b1-b542-47910a1212bb" released by "delete_volume" :: held 0.643s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Created reservations ['ea3e2867-a15e-4782-a955-dd407348030b', 'a9c0ea37-c82e-4516-a9dc-28f37d93c4c5', '201bc830-0e92-42be-bc6b-e97cfce2a276', 'ec9d51f1-d1c3-418f-948d-add3baaa66f0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:45 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:37:45 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:45 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:37:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Deleted volume successfully.
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1362dab9-c9e3-41ed-aae7-71aeeff42ce0 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-a73ebbe7-c2eb-44b1-b542-47910a1212bb-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "cinder-201b7f94-f886-465f-a2ed-0f5adc4ff15e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-201b7f94-f886-465f-a2ed-0f5adc4ff15e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "cinder-quobyte-201b7f94-f886-465f-a2ed-0f5adc4ff15e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-quobyte-201b7f94-f886-465f-a2ed-0f5adc4ff15e" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8137863-cf7b-4894-bc6c-57fbcd5af18d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:45 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e
Nov 06 08:37:45 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:45 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:45 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e
Nov 06 08:37:45 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:46 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-201b7f94-f886-465f-a2ed-0f5adc4ff15e" returned: 0 in 0.252s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-quobyte-201b7f94-f886-465f-a2ed-0f5adc4ff15e" released by "delete_volume" :: held 0.652s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Created reservations ['2be9e2fd-f3c5-4acc-84bb-f4431c459ee6', '35d96775-8418-466d-a723-d015a6bf2030', 'c5244b21-4b18-4a13-8aa7-01d114826e0a', 'bebe16ec-2c29-40f5-bee7-0c225fbf39c4'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:46 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:37:46 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:46 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.256s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:37:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Deleted volume successfully.
Nov 06 08:37:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f77f096c-35e9-4f59-93c2-42242d10b9e6 tempest-TestServerVolumeAttachmentScenario-291228449 None] Lock "cinder-201b7f94-f886-465f-a2ed-0f5adc4ff15e-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:37:56 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:37:56 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=27,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Flow 'volume_create_manager' (05cd0226-b58d-49a1-b5bc-6775e896b29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42956de8-4917-42a5-b468-e8b650fed936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42956de8-4917-42a5-b468-e8b650fed936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828562979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0db4e7f-4fcb-42b3-b636-d03434d5f1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141989fc1d54e26815272ef8ba0026c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:37:58Z,use_quota=True,user_id='d449529332f541a1b3d335693942c446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65821764-df56-4570-ae43-dd4e4bde7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65821764-df56-4570-ae43-dd4e4bde7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069faad8-19b8-4c82-91c5-d04dba2a29ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069faad8-19b8-4c82-91c5-d04dba2a29ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0db4e7f-4fcb-42b3-b636-d03434d5f1c2', 'volume_name': 'volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bc1155-2ed5-4ce8-8ac2-c13839ffb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bc1155-2ed5-4ce8-8ac2-c13839ffb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec82a1d-e5a1-48ad-ad88-2aabbb6cc72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:57 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Volume d0db4e7f-4fcb-42b3-b636-d03434d5f1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2', 'volume_size': 1}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828562979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0db4e7f-4fcb-42b3-b636-d03434d5f1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141989fc1d54e26815272ef8ba0026c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:37:58Z,use_quota=True,user_id='d449529332f541a1b3d335693942c446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Creating volume d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:37:57 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:37:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:57 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 1073741824
Nov 06 08:37:57 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:58 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 1073741824" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:58 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2
Nov 06 08:37:58 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:58 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec82a1d-e5a1-48ad-ad88-2aabbb6cc72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160c0f58-e0a3-41ac-a097-9423b76ba798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:37:58 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Volume volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 (d0db4e7f-4fcb-42b3-b636-d03434d5f1c2): created successfully
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160c0f58-e0a3-41ac-a097-9423b76ba798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Flow 'volume_create_manager' (05cd0226-b58d-49a1-b5bc-6775e896b29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:37:58 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0752588f-a260-485a-b9ca-3570836ed1d2 tempest-ProjectReaderTests-1016022968 None] Created volume successfully.
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Acquiring lock "cinder-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Lock "cinder-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Acquiring lock "cinder-quobyte-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Lock "cinder-quobyte-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2" acquired by "delete_volume" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b4208a-5515-4e2c-99b8-9c99dfaf9eae]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:37:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:59 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2
Nov 06 08:37:59 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:59 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2" returned: 0 in 0.368s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:59 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2
Nov 06 08:37:59 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:59 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2" returned: 0 in 0.251s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Lock "cinder-quobyte-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2" released by "delete_volume" :: held 0.658s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Created reservations ['7e75313e-5b0a-45fc-a497-3dd469a2a2d9', '3747761d-e1f6-4b69-a646-381effc3cd9f', '2207228b-3415-4f18-a1af-4d79b63265c5', '768374a8-daac-401a-8e1c-2e2aca28e12a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:37:59 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:37:59 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:37:59 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:37:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Deleted volume successfully.
Nov 06 08:37:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d649dae-44a0-4cb7-a7be-3f0d8fac852f tempest-ProjectReaderTests-1016022968 None] Lock "cinder-d0db4e7f-4fcb-42b3-b636-d03434d5f1c2-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Flow 'volume_create_manager' (1420420b-7e90-4c33-bde7-d3b657a8b126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351cdb6a-b834-48f2-b4b4-7b04ea3c975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351cdb6a-b834-48f2-b4b4-7b04ea3c975e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829151704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a764792-7388-4f0c-ae04-85a7b056e899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141989fc1d54e26815272ef8ba0026c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:00Z,use_quota=True,user_id='d449529332f541a1b3d335693942c446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8bf93a-55ef-4498-b177-65ed18856d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8bf93a-55ef-4498-b177-65ed18856d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5a5fa-7557-425f-92dc-cceacd131e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5a5fa-7557-425f-92dc-cceacd131e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a764792-7388-4f0c-ae04-85a7b056e899', 'volume_name': 'volume-7a764792-7388-4f0c-ae04-85a7b056e899', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7715c6b7-ad72-469e-a748-21a516ad13bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7715c6b7-ad72-469e-a748-21a516ad13bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1e39ab-6187-4687-8bcc-07324bcc5d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:00 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Volume 7a764792-7388-4f0c-ae04-85a7b056e899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a764792-7388-4f0c-ae04-85a7b056e899', 'volume_size': 1}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829151704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a764792-7388-4f0c-ae04-85a7b056e899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141989fc1d54e26815272ef8ba0026c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:00Z,use_quota=True,user_id='d449529332f541a1b3d335693942c446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Creating volume 7a764792-7388-4f0c-ae04-85a7b056e899 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:00 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:00 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899 1073741824
Nov 06 08:38:00 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:00 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899 1073741824" returned: 0 in 0.404s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:01 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899
Nov 06 08:38:01 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:01 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899" returned: 0 in 0.235s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1e39ab-6187-4687-8bcc-07324bcc5d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a764792-7388-4f0c-ae04-85a7b056e899', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac60bef3-9b2b-4302-8ae8-718f32ebfb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:01 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Volume volume-7a764792-7388-4f0c-ae04-85a7b056e899 (7a764792-7388-4f0c-ae04-85a7b056e899): created successfully
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac60bef3-9b2b-4302-8ae8-718f32ebfb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Flow 'volume_create_manager' (1420420b-7e90-4c33-bde7-d3b657a8b126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:01 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-817a1bd9-3fb1-4718-976f-d0a5bf2ba10f tempest-ProjectReaderTests-1016022968 None] Created volume successfully.
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Acquiring lock "cinder-7a764792-7388-4f0c-ae04-85a7b056e899-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Lock "cinder-7a764792-7388-4f0c-ae04-85a7b056e899-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Acquiring lock "cinder-quobyte-7a764792-7388-4f0c-ae04-85a7b056e899" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Lock "cinder-quobyte-7a764792-7388-4f0c-ae04-85a7b056e899" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1627d70d-1e4b-4591-8353-275e5f592ae7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:01 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899
Nov 06 08:38:01 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:01 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899" returned: 0 in 0.352s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:01 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899
Nov 06 08:38:01 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:02 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7a764792-7388-4f0c-ae04-85a7b056e899" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Lock "cinder-quobyte-7a764792-7388-4f0c-ae04-85a7b056e899" released by "delete_volume" :: held 0.630s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Created reservations ['42e12654-d4fb-4f7d-bf0f-ebdfbd244ea9', '8805507c-c9aa-43a1-8222-4e7ada450768', '13cce771-28e4-4e55-a3af-63c502c8c0e5', '71917240-1962-45d3-8825-aa18ec45bfe0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:02 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:02 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:02 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Deleted volume successfully.
Nov 06 08:38:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7d0ad7e8-9152-4507-8e4d-90def223e3c8 tempest-ProjectReaderTests-1016022968 None] Lock "cinder-7a764792-7388-4f0c-ae04-85a7b056e899-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:12 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:38:12 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=20,cinder:SELECT=10,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (2fc088e7-904d-423e-b5d4-31a1b12b938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6af3e7f-afbb-46a2-8328-69689b9c3570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6af3e7f-afbb-46a2-8328-69689b9c3570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032517142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55202045-df0c-4f5a-a9e9-b3056cac4b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:15Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afffee95-5694-46b2-8b25-504570aca810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afffee95-5694-46b2-8b25-504570aca810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6971aed0-56d0-4bd8-9996-d31b31f0d3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6971aed0-56d0-4bd8-9996-d31b31f0d3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55202045-df0c-4f5a-a9e9-b3056cac4b96', 'volume_name': 'volume-55202045-df0c-4f5a-a9e9-b3056cac4b96', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64920415-a2e3-4f6e-b0ce-266cf964bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64920415-a2e3-4f6e-b0ce-266cf964bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bee01e-08d7-4a3f-b90c-e00d720b661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Volume 55202045-df0c-4f5a-a9e9-b3056cac4b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55202045-df0c-4f5a-a9e9-b3056cac4b96', 'volume_size': 1}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032517142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55202045-df0c-4f5a-a9e9-b3056cac4b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:15Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Creating volume 55202045-df0c-4f5a-a9e9-b3056cac4b96 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:14 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:14 devstack sudo[106564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96 1073741824
Nov 06 08:38:14 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (cba35b0d-194d-48b6-a8f8-da86ede3eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c17f60c-caa5-488b-8b9a-203240ffad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c17f60c-caa5-488b-8b9a-203240ffad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1891117020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ffb6e5-ec4b-4eae-84eb-811df3fb751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:15Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b7a99d-f8dc-432a-833d-3f965f656e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b7a99d-f8dc-432a-833d-3f965f656e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a7bfde-f8ff-4b48-811a-3395494864a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a7bfde-f8ff-4b48-811a-3395494864a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ffb6e5-ec4b-4eae-84eb-811df3fb751d', 'volume_name': 'volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d2ba95-8229-483d-87c8-894ba012dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d2ba95-8229-483d-87c8-894ba012dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5703c6-f7bc-4077-97ec-fce92c27f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Volume 53ffb6e5-ec4b-4eae-84eb-811df3fb751d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d', 'volume_size': 1}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:15 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96 1073741824" returned: 0 in 0.733s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:15 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96
Nov 06 08:38:15 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (ba0538fa-8a5e-4e6f-abc7-3ae2be732b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc748ee9-95a6-4fa3-ac7e-7332febea31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc748ee9-95a6-4fa3-ac7e-7332febea31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1109907167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db8d93-86d6-4359-87b4-5eba41a8a868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:16Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96aa98c-9c75-4384-af25-1f10da5b1585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96aa98c-9c75-4384-af25-1f10da5b1585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125a328d-54f7-48e3-8679-6143df9b0600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125a328d-54f7-48e3-8679-6143df9b0600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51db8d93-86d6-4359-87b4-5eba41a8a868', 'volume_name': 'volume-51db8d93-86d6-4359-87b4-5eba41a8a868', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75475510-8648-4ae5-9771-fb7691ed6fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75475510-8648-4ae5-9771-fb7691ed6fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312fe45b-8376-4c82-8a30-fecbb9d0ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Volume 51db8d93-86d6-4359-87b4-5eba41a8a868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51db8d93-86d6-4359-87b4-5eba41a8a868', 'volume_size': 1}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:16 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96" returned: 0 in 0.605s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1891117020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ffb6e5-ec4b-4eae-84eb-811df3fb751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:15Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Creating volume 53ffb6e5-ec4b-4eae-84eb-811df3fb751d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:16 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bee01e-08d7-4a3f-b90c-e00d720b661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55202045-df0c-4f5a-a9e9-b3056cac4b96', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d 1073741824
Nov 06 08:38:16 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c9ebb0-331f-4222-8de4-1897c4c1ec70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Volume volume-55202045-df0c-4f5a-a9e9-b3056cac4b96 (55202045-df0c-4f5a-a9e9-b3056cac4b96): created successfully
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c9ebb0-331f-4222-8de4-1897c4c1ec70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (2fc088e7-904d-423e-b5d4-31a1b12b938e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:16 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-14e23b33-e5c6-4d76-933c-357bd247b3c9 tempest-CreateVolumesFromImageTest-1835378123 None] Created volume successfully.
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (cb88512f-0675-4287-ba76-285c67826441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70234d31-a66a-4be7-ae79-2548b310eca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70234d31-a66a-4be7-ae79-2548b310eca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875150774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be1b20a-8e89-45a4-81b3-9068c1cb8f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:16Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444518a9-5694-4b59-9086-e30b80abb1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444518a9-5694-4b59-9086-e30b80abb1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcf0213-c854-490e-a1cf-33798c16ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcf0213-c854-490e-a1cf-33798c16ad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be1b20a-8e89-45a4-81b3-9068c1cb8f9a', 'volume_name': 'volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd5659f-bf36-40cb-b6a4-b992db25c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd5659f-bf36-40cb-b6a4-b992db25c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02b6ca0-1a01-4735-8d84-ea8d0b9e114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Volume 4be1b20a-8e89-45a4-81b3-9068c1cb8f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a', 'volume_size': 1}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (65c8a1df-c2c6-42fa-8adf-d222e45ee704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e3f412-6f78-4fcf-ae4b-d807bf615dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e3f412-6f78-4fcf-ae4b-d807bf615dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1016111593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd41999-05be-49e2-a5d7-381f92839718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:17Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d385afa-ef59-442d-ae43-e907e6ed49f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d385afa-ef59-442d-ae43-e907e6ed49f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8828be-4ee1-4a15-a881-373617ffdfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8828be-4ee1-4a15-a881-373617ffdfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd41999-05be-49e2-a5d7-381f92839718', 'volume_name': 'volume-7cd41999-05be-49e2-a5d7-381f92839718', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f12e8e-e606-41e7-9b00-4ee6852ba8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f12e8e-e606-41e7-9b00-4ee6852ba8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2cc7d1-bc88-482e-bc0e-7da2f302a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Volume 7cd41999-05be-49e2-a5d7-381f92839718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd41999-05be-49e2-a5d7-381f92839718', 'volume_size': 1}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:16 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d 1073741824" returned: 0 in 0.730s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:16 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d
Nov 06 08:38:16 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (f1a30fb4-00de-4645-8cda-a94886dcf7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:17 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e367e08-0eaa-4e98-8490-58937fdf8d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d" returned: 0 in 0.387s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1109907167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db8d93-86d6-4359-87b4-5eba41a8a868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:16Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Creating volume 51db8d93-86d6-4359-87b4-5eba41a8a868 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:17 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:17 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868 1073741824
Nov 06 08:38:17 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e367e08-0eaa-4e98-8490-58937fdf8d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14812746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:17Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0affe4-8dff-4606-bf0f-103358c8939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0affe4-8dff-4606-bf0f-103358c8939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3c2b97-ba8c-4f65-b9d3-87e1ea0e6fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3c2b97-ba8c-4f65-b9d3-87e1ea0e6fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f', 'volume_name': 'volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154ee5fc-69ee-49e4-9aae-d8292d8a10d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154ee5fc-69ee-49e4-9aae-d8292d8a10d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc979dcb-5616-4469-9c02-e690d5f8c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:17 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Volume 889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f', 'volume_size': 1}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5703c6-f7bc-4077-97ec-fce92c27f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f302db28-f8b5-47a7-a40f-3388851488f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:17 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Volume volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d (53ffb6e5-ec4b-4eae-84eb-811df3fb751d): created successfully
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f302db28-f8b5-47a7-a40f-3388851488f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (cba35b0d-194d-48b6-a8f8-da86ede3eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1ad439f3-dc4e-447e-a35c-a8cfd4eb6044 tempest-CreateVolumesFromImageTest-1835378123 None] Created volume successfully.
Nov 06 08:38:17 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868 1073741824" returned: 0 in 0.549s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:17 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868
Nov 06 08:38:17 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Flow 'volume_create_manager' (2b840d60-18ec-424b-80e1-531f6ee90c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:17 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2cc52f9-e9b5-4725-a886-540e6ab81db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2cc52f9-e9b5-4725-a886-540e6ab81db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937716eb-9d5b-4f25-98ac-7eacbca0b242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58135b71552a4b7682874422f78c3a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:18Z,use_quota=True,user_id='0c308cb8f53448b898e70f1f4fba4ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72350f0e-472e-433b-96fb-d5546504a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72350f0e-472e-433b-96fb-d5546504a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96886a8-6a47-487b-9aeb-81922a4fcb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:38:18 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868" returned: 0 in 0.309s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875150774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be1b20a-8e89-45a4-81b3-9068c1cb8f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:16Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Creating volume 4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:18 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312fe45b-8376-4c82-8a30-fecbb9d0ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51db8d93-86d6-4359-87b4-5eba41a8a868', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:18 devstack sudo[106628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a 1073741824
Nov 06 08:38:18 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e14327-4dd1-4fdc-ae28-097025c279c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:18 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Volume volume-51db8d93-86d6-4359-87b4-5eba41a8a868 (51db8d93-86d6-4359-87b4-5eba41a8a868): created successfully
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e14327-4dd1-4fdc-ae28-097025c279c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (ba0538fa-8a5e-4e6f-abc7-3ae2be732b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a4eebf05-7e1b-4fa4-8e5d-970e63ead273 tempest-CreateVolumesFromImageTest-1835378123 None] Created volume successfully.
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96886a8-6a47-487b-9aeb-81922a4fcb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '937716eb-9d5b-4f25-98ac-7eacbca0b242', 'volume_name': 'volume-937716eb-9d5b-4f25-98ac-7eacbca0b242', 'volume_size': 1, 'image_id': '83a23456-8462-4580-89ae-79984fbd15ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a23456-8462-4580-89ae-79984fbd15ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dea68b66ebabbb99a7546e2b3060a4fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58135b71552a4b7682874422f78c3a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0803515f3bc129fe77807fbbb769af7836a7e2fa3b32877d8afdc03df6d5c091af2a1f738e586f3a56b589d51515ecc63704172836d85d6adc46e87634787276', 'id': '83a23456-8462-4580-89ae-79984fbd15ea', 'created_at': datetime.datetime(2026, 11, 6, 7, 38, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 38, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a23456-8462-4580-89ae-79984fbd15ea/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107572570>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687f4f57-5aa5-4b4c-b2c4-00e9ac800362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687f4f57-5aa5-4b4c-b2c4-00e9ac800362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bbc52b-14a0-45a9-b326-ae32d707261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:18 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Volume 937716eb-9d5b-4f25-98ac-7eacbca0b242: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-937716eb-9d5b-4f25-98ac-7eacbca0b242', 'volume_size': 1, 'image_id': '83a23456-8462-4580-89ae-79984fbd15ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a23456-8462-4580-89ae-79984fbd15ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dea68b66ebabbb99a7546e2b3060a4fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58135b71552a4b7682874422f78c3a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0803515f3bc129fe77807fbbb769af7836a7e2fa3b32877d8afdc03df6d5c091af2a1f738e586f3a56b589d51515ecc63704172836d85d6adc46e87634787276', 'id': '83a23456-8462-4580-89ae-79984fbd15ea', 'created_at': datetime.datetime(2026, 11, 6, 7, 38, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 38, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a23456-8462-4580-89ae-79984fbd15ea/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107572570>}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Trying to clone 937716eb-9d5b-4f25-98ac-7eacbca0b242 from image 83a23456-8462-4580-89ae-79984fbd15ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/83a23456-8462-4580-89ae-79984fbd15ea', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:38:18 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f06745d-1fce-4cdb-b3ef-70cf13eb42c5]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:18 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD
Nov 06 08:38:18 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:18 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a 1073741824" returned: 0 in 0.515s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:18 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a
Nov 06 08:38:18 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:18 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:19 devstack sudo[106640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD
Nov 06 08:38:19 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:19 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" returned: 0 in 0.289s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1016111593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd41999-05be-49e2-a5d7-381f92839718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:17Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Creating volume 7cd41999-05be-49e2-a5d7-381f92839718 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:19 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02b6ca0-1a01-4735-8d84-ea8d0b9e114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:19 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718 1073741824
Nov 06 08:38:19 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bce01a-2bae-41ec-993a-2d22918b739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:19 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Volume volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a (4be1b20a-8e89-45a4-81b3-9068c1cb8f9a): created successfully
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bce01a-2bae-41ec-993a-2d22918b739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (cb88512f-0675-4287-ba76-285c67826441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fb123370-7627-4d4e-9b4f-5f8ac2599501 tempest-ProjectReaderTests-1513806032 None] Created volume successfully.
Nov 06 08:38:19 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Temporary image 83a23456-8462-4580-89ae-79984fbd15ea is fetched for user 0c308cb8f53448b898e70f1f4fba4ff5. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccac18c4-c546-45df-a547-102ee67fc7ec]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:19 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD
Nov 06 08:38:19 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:19 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718 1073741824" returned: 0 in 0.619s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:19 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718
Nov 06 08:38:19 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:19 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Flow 'volume_create_manager' (c8c29a05-9821-4f7e-8851-f782f6ec5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614dc4cc-5735-4368-a53f-760be077821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614dc4cc-5735-4368-a53f-760be077821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4875832-3aa3-46c8-be76-dbfde5a0760e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa144426d4c449282576656156c769d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:20Z,use_quota=True,user_id='c101764499bb4944a5d7c735a41a24e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c214438-a251-47c7-84c4-192b7cd67238),volume_type_id=8c214438-a251-47c7-84c4-192b7cd67238)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3839c0-11cd-493b-baca-7762a79b66e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3839c0-11cd-493b-baca-7762a79b66e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeaa535-935c-44ef-949f-a6874c54ded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:19 devstack cinder-volume[87143]: DEBUG cinder.image.glance [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Creating Keystone auth plugin from conf {{(pid=87143) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 08:38:19 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD
Nov 06 08:38:19 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:20 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.668s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14812746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec438df5c994c068365867b357f8411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:17Z,use_quota=True,user_id='fe42896402434e9c9658713b6a60f830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Creating volume 889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:20 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2cc7d1-bc88-482e-bc0e-7da2f302a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd41999-05be-49e2-a5d7-381f92839718', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf21b4ec-5b93-43f7-b9a2-11e5794430dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:20 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f 1073741824
Nov 06 08:38:20 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:20 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Volume volume-7cd41999-05be-49e2-a5d7-381f92839718 (7cd41999-05be-49e2-a5d7-381f92839718): created successfully
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf21b4ec-5b93-43f7-b9a2-11e5794430dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (65c8a1df-c2c6-42fa-8adf-d222e45ee704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c903ca20-a8a3-48d7-94b4-e2feec87a037 tempest-CreateVolumesFromImageTest-1835378123 None] Created volume successfully.
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeaa535-935c-44ef-949f-a6874c54ded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4875832-3aa3-46c8-be76-dbfde5a0760e', 'volume_name': 'volume-b4875832-3aa3-46c8-be76-dbfde5a0760e', 'volume_size': 1, 'image_id': 'f7543b61-cf74-4457-b454-8176634ec810', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7543b61-cf74-4457-b454-8176634ec810', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db912cae3dad5e573f21a393f1ee5d5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa144426d4c449282576656156c769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3310a75edadd337281e5bbcff2bc62530248339a24ba2df3139857110ea5502057651ffb1c3897bf008a3cf8162c00f9a8e5f590b8b2fb6dbc34adb7bfe204f', 'id': 'f7543b61-cf74-4457-b454-8176634ec810', 'created_at': datetime.datetime(2026, 11, 6, 7, 38, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 38, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7543b61-cf74-4457-b454-8176634ec810/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc546b0>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be3b99c-00ac-40f4-aef5-4c4271924e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be3b99c-00ac-40f4-aef5-4c4271924e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b0ef0-175b-444c-b78b-a010a73d3bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:20 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Volume b4875832-3aa3-46c8-be76-dbfde5a0760e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4875832-3aa3-46c8-be76-dbfde5a0760e', 'volume_size': 1, 'image_id': 'f7543b61-cf74-4457-b454-8176634ec810', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7543b61-cf74-4457-b454-8176634ec810', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db912cae3dad5e573f21a393f1ee5d5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa144426d4c449282576656156c769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3310a75edadd337281e5bbcff2bc62530248339a24ba2df3139857110ea5502057651ffb1c3897bf008a3cf8162c00f9a8e5f590b8b2fb6dbc34adb7bfe204f', 'id': 'f7543b61-cf74-4457-b454-8176634ec810', 'created_at': datetime.datetime(2026, 11, 6, 7, 38, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 38, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7543b61-cf74-4457-b454-8176634ec810/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc546b0>}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Trying to clone b4875832-3aa3-46c8-be76-dbfde5a0760e from image f7543b61-cf74-4457-b454-8176634ec810 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7543b61-cf74-4457-b454-8176634ec810', 'metadata': {}}]). {{(pid=87143) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 08:38:20 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 08:38:20 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd68b7d-2645-41be-aefa-76c80a09cd7c]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:20 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD
Nov 06 08:38:20 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:20 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f 1073741824" returned: 0 in 0.468s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:20 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f
Nov 06 08:38:20 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:20 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:20 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD
Nov 06 08:38:20 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:20 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Creating offline snapshot de16f809-c548-40ba-b018-b172346ccfe6 of volume 4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc979dcb-5616-4469-9c02-e690d5f8c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9138816-82e0-4346-9e17-cc8c3de83f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e71c6d0-a0b2-41a0-b358-2dc8519eda2b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:20 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Volume volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f (889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f): created successfully
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9138816-82e0-4346-9e17-cc8c3de83f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:20 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Flow 'volume_create_manager' (f1a30fb4-00de-4645-8cda-a94886dcf7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4194fc66-2cc5-451b-8f3c-6232f8cb85c8 tempest-CreateVolumesFromImageTest-1835378123 None] Created volume successfully.
Nov 06 08:38:20 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a
Nov 06 08:38:20 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:21 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Temporary image f7543b61-cf74-4457-b454-8176634ec810 is fetched for user c101764499bb4944a5d7c735a41a24e1. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0a2796-ad5a-4a10-bbb8-d5f9120604b8]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:21 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD
Nov 06 08:38:21 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:21 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" returned: 0 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:21 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 1G
Nov 06 08:38:21 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:21 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:21 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD
Nov 06 08:38:21 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:21 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 1G" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:21 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6
Nov 06 08:38:21 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:21 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-quobyte-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:21 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6" returned: 0 in 0.308s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:21 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 is being set with open permissions: ugo+rw
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de5a17c-5206-4252-843b-189839c927c5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:21 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6
Nov 06 08:38:21 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:22 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f
Nov 06 08:38:22 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:22 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:22 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.info
Nov 06 08:38:22 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:22 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f" returned: 0 in 0.380s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:22 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f
Nov 06 08:38:22 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:22 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.info" returned: 0 in 0.263s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:22 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.info is being set with open permissions: ugo+rw
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:22 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.info
Nov 06 08:38:22 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:22 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f" released by "delete_volume" :: held 0.688s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Created reservations ['bfb1b385-aa46-479c-9f2e-4f4e96e1552b', '93cb90a9-bc16-4c22-b8fb-f6546a0ca4d9', '85bea003-0c25-4d19-9646-80ea02e1e320', 'ff6d67cb-9015-426e-8445-ab8b5fcffd08'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:22 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.info" returned: 0 in 0.269s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:22 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:22 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.532s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937716eb-9d5b-4f25-98ac-7eacbca0b242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58135b71552a4b7682874422f78c3a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:18Z,use_quota=True,user_id='0c308cb8f53448b898e70f1f4fba4ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Creating volume 937716eb-9d5b-4f25-98ac-7eacbca0b242 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:22 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:22 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 1073741824
Nov 06 08:38:22 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c931a505-0fad-4961-b54a-796a13e7271e tempest-ProjectReaderTests-1513806032 None] Create snapshot completed successfully
Nov 06 08:38:23 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-7cd41999-05be-49e2-a5d7-381f92839718-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.272s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Deleted volume successfully.
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-7cd41999-05be-49e2-a5d7-381f92839718-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb2331a-cd77-4557-b87e-71cbb036318d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-889e6a3b-f586-4f1a-a44a-0a0ff54c1c1f-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-quobyte-7cd41999-05be-49e2-a5d7-381f92839718" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-7cd41999-05be-49e2-a5d7-381f92839718" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5df2d5-ae8a-46ef-a721-2ac0627ca59a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:23 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718
Nov 06 08:38:23 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:23 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 1073741824" returned: 0 in 0.487s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:23 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242
Nov 06 08:38:23 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:23 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718" returned: 0 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:23 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718
Nov 06 08:38:23 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:23 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242" returned: 0 in 0.262s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4875832-3aa3-46c8-be76-dbfde5a0760e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa144426d4c449282576656156c769d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:20Z,use_quota=True,user_id='c101764499bb4944a5d7c735a41a24e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c214438-a251-47c7-84c4-192b7cd67238),volume_type_id=8c214438-a251-47c7-84c4-192b7cd67238)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Creating volume b4875832-3aa3-46c8-be76-dbfde5a0760e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:23 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:23 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e 1073741824
Nov 06 08:38:23 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Attempting download of 83a23456-8462-4580-89ae-79984fbd15ea ((None, [{'url': 'file:///opt/stack/data/glance/images/83a23456-8462-4580-89ae-79984fbd15ea', 'metadata': {}}])) to volume 937716eb-9d5b-4f25-98ac-7eacbca0b242. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6806cc-d9ea-4f48-8323-80976b4671bc]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a23456-8462-4580-89ae-79984fbd15ea_t57851zi {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:23 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-7cd41999-05be-49e2-a5d7-381f92839718" returned: 0 in 0.292s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-7cd41999-05be-49e2-a5d7-381f92839718" released by "delete_volume" :: held 0.720s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:23 devstack sudo[106744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a23456-8462-4580-89ae-79984fbd15ea_t57851zi
Nov 06 08:38:23 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:23 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Created reservations ['85c68e42-fea4-41b4-9abb-ab06e66fa223', '23938e20-beec-4aee-8898-baf4ba39f37e', '2f91d200-509c-4202-a863-01498c3b4de0', 'abc45178-ed43-4903-a520-64b7edabf9e2'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:24 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-de16f809-c548-40ba-b018-b172346ccfe6-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-de16f809-c548-40ba-b018-b172346ccfe6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:24 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a23456-8462-4580-89ae-79984fbd15ea_t57851zi" returned: 0 in 0.383s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a23456-8462-4580-89ae-79984fbd15ea_t57851zi {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-de16f809-c548-40ba-b018-b172346ccfe6" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-de16f809-c548-40ba-b018-b172346ccfe6" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Deleting offline snapshot de16f809-c548-40ba-b018-b172346ccfe6 of volume 4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:38:24 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] snapshot_file for this snap is: volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e 1073741824" returned: 0 in 0.633s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc7dd82-ce42-4c37-87cb-4dbf22189a8c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a23456-8462-4580-89ae-79984fbd15ea_t57851zi
Nov 06 08:38:24 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-51db8d93-86d6-4359-87b4-5eba41a8a868-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-51db8d93-86d6-4359-87b4-5eba41a8a868-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:24 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e
Nov 06 08:38:24 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Deleted volume successfully.
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-quobyte-51db8d93-86d6-4359-87b4-5eba41a8a868" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:24 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6
Nov 06 08:38:24 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-937ea120-cf0d-4af8-a77b-65418b32f377 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-7cd41999-05be-49e2-a5d7-381f92839718-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-51db8d93-86d6-4359-87b4-5eba41a8a868" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d6c289-9e3a-4e2f-b618-3aa6b7322771]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a23456-8462-4580-89ae-79984fbd15ea_t57851zi" returned: 1 in 0.455s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a23456-8462-4580-89ae-79984fbd15ea_t57851zi' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3824b2eb-20ea-41e4-a456-af5f659885c7]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868
Nov 06 08:38:24 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e" returned: 0 in 0.324s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Attempting download of f7543b61-cf74-4457-b454-8176634ec810 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7543b61-cf74-4457-b454-8176634ec810', 'metadata': {}}])) to volume b4875832-3aa3-46c8-be76-dbfde5a0760e. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 08:38:24 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD
Nov 06 08:38:24 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6" returned: 0 in 0.480s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e8c68-35d3-4d88-a8d4-08928f6c658c]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7543b61-cf74-4457-b454-8176634ec810_tv8h216v {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dca9748-37fe-44f0-aa8b-6af2b9d4866d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868" returned: 0 in 0.405s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:24 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7543b61-cf74-4457-b454-8176634ec810_tv8h216v
Nov 06 08:38:24 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868
Nov 06 08:38:24 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a
Nov 06 08:38:24 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:24 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD
Nov 06 08:38:25 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:25 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7543b61-cf74-4457-b454-8176634ec810_tv8h216v" returned: 0 in 0.368s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7543b61-cf74-4457-b454-8176634ec810_tv8h216v {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" returned: 0 in 0.424s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-51db8d93-86d6-4359-87b4-5eba41a8a868" returned: 0 in 0.339s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:25 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6
Nov 06 08:38:25 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-51db8d93-86d6-4359-87b4-5eba41a8a868" released by "delete_volume" :: held 0.813s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:25 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7543b61-cf74-4457-b454-8176634ec810_tv8h216v
Nov 06 08:38:25 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Created reservations ['7d752402-5b25-4634-bba8-e0ccd3c3671e', '6ed609b0-253e-4b2d-bc41-f3c72cee9f3d', '79694c13-0aa2-4c88-a614-0f41bde0c0f0', '6203914c-6868-487d-84bb-f47559a41aba'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:25 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] 83a23456-8462-4580-89ae-79984fbd15ea was raw, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242
Nov 06 08:38:25 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack sudo[106801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:25 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-53ffb6e5-ec4b-4eae-84eb-811df3fb751d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:25 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7543b61-cf74-4457-b454-8176634ec810_tv8h216v" returned: 1 in 0.425s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7543b61-cf74-4457-b454-8176634ec810_tv8h216v' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbeb231-ef72-4150-89aa-7b2af0947467]: (4, 'raw') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-53ffb6e5-ec4b-4eae-84eb-811df3fb751d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-quobyte-53ffb6e5-ec4b-4eae-84eb-811df3fb751d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:25 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-53ffb6e5-ec4b-4eae-84eb-811df3fb751d" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6" returned: 0 in 0.498s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD
Nov 06 08:38:25 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7a623-3f3b-4e5f-9c43-8edfc9a603db]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:25 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6
Nov 06 08:38:25 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:25 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Deleted volume successfully.
Nov 06 08:38:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4217d8f8-ad7f-4f0e-a5dc-dfc7a41ec32d tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-51db8d93-86d6-4359-87b4-5eba41a8a868-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:25 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d
Nov 06 08:38:25 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:26 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a.de16f809-c548-40ba-b018-b172346ccfe6" returned: 0 in 0.335s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:26 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:26 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242" returned: 0 in 0.730s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83a23456-8462-4580-89ae-79984fbd15ea_3iq0rt6ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:38:26 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-de16f809-c548-40ba-b018-b172346ccfe6" released by "_delete_snapshot" :: held 1.916s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:26 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 1G
Nov 06 08:38:26 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" released by "delete_snapshot" :: held 1.988s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:26 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d" returned: 0 in 0.517s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Created reservations ['1c65c6f2-58d0-444e-b4e7-d9e796c430f0', '3e431900-adb3-48cc-8c7e-a3a8f18c253a', 'ded38111-290f-4350-8d7a-60198885a7c1', '741248d8-a423-4064-82e7-e755956e9a0b'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:26 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD
Nov 06 08:38:26 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:26 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d
Nov 06 08:38:26 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Delete snapshot completed successfully.
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3b49dd31-a752-46f7-b429-bb776c3b1c78 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-de16f809-c548-40ba-b018-b172346ccfe6-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:26 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 1G" returned: 0 in 0.435s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Downloaded image 83a23456-8462-4580-89ae-79984fbd15ea ((None, [{'url': 'file:///opt/stack/data/glance/images/83a23456-8462-4580-89ae-79984fbd15ea', 'metadata': {}}])) to volume 937716eb-9d5b-4f25-98ac-7eacbca0b242 successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Temporary image 83a23456-8462-4580-89ae-79984fbd15ea for user 0c308cb8f53448b898e70f1f4fba4ff5 is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Marking volume 937716eb-9d5b-4f25-98ac-7eacbca0b242 as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Copying metadata from image 83a23456-8462-4580-89ae-79984fbd15ea to 937716eb-9d5b-4f25-98ac-7eacbca0b242. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Creating volume glance metadata for volume 937716eb-9d5b-4f25-98ac-7eacbca0b242 backed by image 83a23456-8462-4580-89ae-79984fbd15ea with: {'image_id': '83a23456-8462-4580-89ae-79984fbd15ea', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dea68b66ebabbb99a7546e2b3060a4fb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:38:26 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD" returned: 1 in 0.454s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] f7543b61-cf74-4457-b454-8176634ec810 was raw, converting to qcow2 {{(pid=87143) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:26 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-53ffb6e5-ec4b-4eae-84eb-811df3fb751d" returned: 0 in 0.341s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:26 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e
Nov 06 08:38:26 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-53ffb6e5-ec4b-4eae-84eb-811df3fb751d" released by "delete_volume" :: held 0.917s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bbc52b-14a0-45a9-b326-ae32d707261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937716eb-9d5b-4f25-98ac-7eacbca0b242', 'volume_size': 1, 'image_id': '83a23456-8462-4580-89ae-79984fbd15ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a23456-8462-4580-89ae-79984fbd15ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dea68b66ebabbb99a7546e2b3060a4fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58135b71552a4b7682874422f78c3a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0803515f3bc129fe77807fbbb769af7836a7e2fa3b32877d8afdc03df6d5c091af2a1f738e586f3a56b589d51515ecc63704172836d85d6adc46e87634787276', 'id': '83a23456-8462-4580-89ae-79984fbd15ea', 'created_at': datetime.datetime(2026, 11, 6, 7, 38, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 38, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a23456-8462-4580-89ae-79984fbd15ea/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd107572570>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9ec5b8-d6f8-4b49-9c79-b5ab8f0b7913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:26 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Volume volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 (937716eb-9d5b-4f25-98ac-7eacbca0b242): created successfully
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9ec5b8-d6f8-4b49-9c79-b5ab8f0b7913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Flow 'volume_create_manager' (2b840d60-18ec-424b-80e1-531f6ee90c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-82ce2340-63f4-4671-b3db-ed58a30bab84 tempest-VolumeImageDependencyTests-1721360247 None] Created volume successfully.
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Created reservations ['75cc8519-0fd3-4393-a8c0-6ffb5fd6d7c2', 'f8d7d46e-11a6-4f47-a0a4-6b5f2f4a880d', '0a9d54df-cf28-4e82-9068-46a5582eb2d1', 'fff962b8-0277-4e7b-a982-aa41aa09bc10'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:26 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:26 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:27 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e" returned: 0 in 0.456s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7543b61-cf74-4457-b454-8176634ec810_3apfrpaidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:38:27 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:27 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.267s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Deleted volume successfully.
Nov 06 08:38:27 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e 1G
Nov 06 08:38:27 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-86ec18a3-3567-4fb2-a731-54c684fb79a8 tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-53ffb6e5-ec4b-4eae-84eb-811df3fb751d-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:27 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e 1G" returned: 0 in 0.363s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Downloaded image f7543b61-cf74-4457-b454-8176634ec810 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7543b61-cf74-4457-b454-8176634ec810', 'metadata': {}}])) to volume b4875832-3aa3-46c8-be76-dbfde5a0760e successfully. {{(pid=87143) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Temporary image f7543b61-cf74-4457-b454-8176634ec810 for user c101764499bb4944a5d7c735a41a24e1 is deleted. {{(pid=87143) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.volume_utils [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Marking volume b4875832-3aa3-46c8-be76-dbfde5a0760e as bootable. {{(pid=87143) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Copying metadata from image f7543b61-cf74-4457-b454-8176634ec810 to b4875832-3aa3-46c8-be76-dbfde5a0760e. {{(pid=87143) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Creating volume glance metadata for volume b4875832-3aa3-46c8-be76-dbfde5a0760e backed by image f7543b61-cf74-4457-b454-8176634ec810 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f7543b61-cf74-4457-b454-8176634ec810', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'db912cae3dad5e573f21a393f1ee5d5e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87143) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[161427e1-7c19-454a-81ca-56c616e5b747]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b0ef0-175b-444c-b78b-a010a73d3bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4875832-3aa3-46c8-be76-dbfde5a0760e', 'volume_size': 1, 'image_id': 'f7543b61-cf74-4457-b454-8176634ec810', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7543b61-cf74-4457-b454-8176634ec810', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db912cae3dad5e573f21a393f1ee5d5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa144426d4c449282576656156c769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3310a75edadd337281e5bbcff2bc62530248339a24ba2df3139857110ea5502057651ffb1c3897bf008a3cf8162c00f9a8e5f590b8b2fb6dbc34adb7bfe204f', 'id': 'f7543b61-cf74-4457-b454-8176634ec810', 'created_at': datetime.datetime(2026, 11, 6, 7, 38, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 7, 38, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7543b61-cf74-4457-b454-8176634ec810/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0fcc546b0>}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a7cb88-c2b3-4b0a-9fd3-02871fae26cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:27 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Volume volume-b4875832-3aa3-46c8-be76-dbfde5a0760e (b4875832-3aa3-46c8-be76-dbfde5a0760e): created successfully
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a7cb88-c2b3-4b0a-9fd3-02871fae26cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Flow 'volume_create_manager' (c8c29a05-9821-4f7e-8851-f782f6ec5831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:27 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a
Nov 06 08:38:27 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f53afc9b-e446-4648-9c67-5c776b385ba4 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Created volume successfully.
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Acquiring lock "cinder-937716eb-9d5b-4f25-98ac-7eacbca0b242-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Lock "cinder-937716eb-9d5b-4f25-98ac-7eacbca0b242-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Acquiring lock "cinder-quobyte-937716eb-9d5b-4f25-98ac-7eacbca0b242" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Lock "cinder-quobyte-937716eb-9d5b-4f25-98ac-7eacbca0b242" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6731be1-0fbf-48ec-921a-980ba7fc4521]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-55202045-df0c-4f5a-a9e9-b3056cac4b96-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:27 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:27 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242
Nov 06 08:38:27 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" returned: 0 in 0.422s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-55202045-df0c-4f5a-a9e9-b3056cac4b96-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:27 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a
Nov 06 08:38:27 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "cinder-quobyte-55202045-df0c-4f5a-a9e9-b3056cac4b96" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-55202045-df0c-4f5a-a9e9-b3056cac4b96" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087b839-7979-4e3a-81b3-9b9d167b3618]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:28 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96
Nov 06 08:38:28 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:28 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:28 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242" returned: 0 in 0.420s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" returned: 0 in 0.295s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:28 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a" released by "delete_volume" :: held 0.788s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:28 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Created reservations ['587cfec2-85ab-4aa9-b48e-3a50b5abaffa', '79cdf3a1-dfbc-4a3d-a43a-af45984d6729', 'fc63ddce-65ed-4d9e-9dfd-628dd76f9a60', '759fa759-8eaa-437c-8a07-d4fc29489a12'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:28 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Acquiring lock "cinder-b4875832-3aa3-46c8-be76-dbfde5a0760e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96" returned: 0 in 0.481s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:28 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:28 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "cinder-b4875832-3aa3-46c8-be76-dbfde5a0760e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:28 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96
Nov 06 08:38:28 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:28 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Acquiring lock "cinder-quobyte-b4875832-3aa3-46c8-be76-dbfde5a0760e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-937716eb-9d5b-4f25-98ac-7eacbca0b242" returned: 0 in 0.421s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "cinder-quobyte-b4875832-3aa3-46c8-be76-dbfde5a0760e" acquired by "delete_volume" :: waited 0.031s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Lock "cinder-quobyte-937716eb-9d5b-4f25-98ac-7eacbca0b242" released by "delete_volume" :: held 0.911s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f410c8-5172-43dc-97f2-28f510f6480e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Created reservations ['f160c661-0f39-4abd-9e5a-a399a8feef25', 'e677ca70-6f19-4ab3-8a10-9ae7cfbe5b98', '524c9c55-901a-4453-b070-c25344bbf4d6', '1579dddb-cfb8-41e7-8eb1-986cdd9814f8'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:28 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:28 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.416s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:28 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:28 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Deleted volume successfully.
Nov 06 08:38:28 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-55202045-df0c-4f5a-a9e9-b3056cac4b96" returned: 0 in 0.388s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-quobyte-55202045-df0c-4f5a-a9e9-b3056cac4b96" released by "delete_volume" :: held 0.941s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-03114ec1-e72a-454a-b736-d619155959b3 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-4be1b20a-8e89-45a4-81b3-9068c1cb8f9a-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:28 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:28 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:28 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Created reservations ['627c4ab5-f10d-4324-b351-e01659f8d0d9', 'b2795494-b89d-48cb-b0cf-1e334b32e5cf', 'a8390612-1c94-48f7-b83f-071ee353c0e6', '8f8cbdee-6e24-46f8-9edf-6d98653bc5c3'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:29 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:29 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:29 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e" returned: 0 in 0.660s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:29 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.438s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Deleted volume successfully.
Nov 06 08:38:29 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e
Nov 06 08:38:29 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-91855dc4-5687-4c3f-903b-070f6c8c33c1 tempest-VolumeImageDependencyTests-1721360247 None] Lock "cinder-937716eb-9d5b-4f25-98ac-7eacbca0b242-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (d697b713-02a0-4734-b637-cb464cd4921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:29 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175aa015-cb45-4d18-939c-614b568ac0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.314s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Deleted volume successfully.
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175aa015-cb45-4d18-939c-614b568ac0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783781145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:29Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd7d610-4703-48f8-98bb-e936a360d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd7d610-4703-48f8-98bb-e936a360d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3f72e7-f527-4967-b3d8-1d61e847e248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3f72e7-f527-4967-b3d8-1d61e847e248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08', 'volume_name': 'volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47665c41-0ed4-4747-ab7f-24cd27d5ff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47665c41-0ed4-4747-ab7f-24cd27d5ff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a392d338-5e05-47ce-a6b7-75baa864cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:29 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Volume 5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08', 'volume_size': 1}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783781145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:29Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Creating volume 5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:29 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9ae56c42-7e53-4512-812d-9bd30f26456a tempest-CreateVolumesFromImageTest-1835378123 None] Lock "cinder-55202045-df0c-4f5a-a9e9-b3056cac4b96-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:29 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 1073741824
Nov 06 08:38:29 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:29 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b4875832-3aa3-46c8-be76-dbfde5a0760e" returned: 0 in 0.362s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "cinder-quobyte-b4875832-3aa3-46c8-be76-dbfde5a0760e" released by "delete_volume" :: held 1.078s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Created reservations ['e2a70d73-d76a-4a7f-878a-e0b26f0206d5', 'dc025820-c277-413f-b01c-94297207aef9', 'ed700499-65d7-4b8a-9ecd-128488829a60', 'c6c79e76-dbd9-432d-a2f7-14b02373e93e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:29 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:29 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:30 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 1073741824" returned: 0 in 0.552s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:30 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.303s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Deleted volume successfully.
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cccb9680-c197-4ec7-bc76-5e1c33c672c1 tempest-VolumeAndVolumeTypeFromImageTest-990391743 None] Lock "cinder-b4875832-3aa3-46c8-be76-dbfde5a0760e-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:30 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08
Nov 06 08:38:30 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:30 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" returned: 0 in 0.281s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a392d338-5e05-47ce-a6b7-75baa864cae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226013cf-06fd-4dce-822b-8d7679675833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:30 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:30 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:30 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Volume volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 (5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08): created successfully
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226013cf-06fd-4dce-822b-8d7679675833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (d697b713-02a0-4734-b637-cb464cd4921e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:30 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ad7c55cd-e93e-414f-b8fc-78815d7fe6ed tempest-ProjectReaderTests-1513806032 None] Created volume successfully.
Nov 06 08:38:30 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.292s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:38:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:38:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Creating offline snapshot 4f038971-bbd3-4004-a837-72efba09b9e2 of volume 5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:38:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a488288-a542-4234-ac8b-ee0fcf8d90e9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:31 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08
Nov 06 08:38:31 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:32 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" returned: 0 in 0.432s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:32 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 1G
Nov 06 08:38:32 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:32 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 1G" returned: 0 in 0.625s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:32 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2
Nov 06 08:38:32 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:33 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2" returned: 0 in 0.450s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:33 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 is being set with open permissions: ugo+rw
Nov 06 08:38:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:33 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2
Nov 06 08:38:33 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:33 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2" returned: 0 in 0.283s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-59cba150-2a56-4d02-8bc0-f8b2329d3a24 tempest-ProjectAdminTests-1002538076 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4119873046875, 'free_capacity_gb': 1773.4119873046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87143) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 08:38:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:33 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.info
Nov 06 08:38:33 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:33 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.info" returned: 0 in 0.312s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:33 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.info is being set with open permissions: ugo+rw
Nov 06 08:38:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:33 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.info
Nov 06 08:38:33 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (37fbb452-c5e2-4c3f-b6a0-8e461b643d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf062c9-6bd1-4d75-9b98-f81a283e5ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf062c9-6bd1-4d75-9b98-f81a283e5ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784754887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2d6d48-fa95-48d0-8a5c-913eaca1bdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:34Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:34 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c7abf-23db-4c8d-8cee-599a321a87b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c7abf-23db-4c8d-8cee-599a321a87b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b9d65c-c44e-4b29-9ae8-a7d5c4c386bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b9d65c-c44e-4b29-9ae8-a7d5c4c386bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2d6d48-fa95-48d0-8a5c-913eaca1bdce', 'volume_name': 'volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d0920-a4fa-4a27-838c-04653a110ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d0920-a4fa-4a27-838c-04653a110ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5aa309-4fc4-4534-af82-69f6952f489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume eb2d6d48-fa95-48d0-8a5c-913eaca1bdce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce', 'volume_size': 1}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.info" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784754887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2d6d48-fa95-48d0-8a5c-913eaca1bdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:34Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Creating volume eb2d6d48-fa95-48d0-8a5c-913eaca1bdce {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:34 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:34 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce 1073741824
Nov 06 08:38:34 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-73ac1c72-74f4-4a80-9711-6ef0132d37f0 tempest-ProjectReaderTests-1513806032 None] Create snapshot completed successfully
Nov 06 08:38:34 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce 1073741824" returned: 0 in 0.547s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-4f038971-bbd3-4004-a837-72efba09b9e2-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-4f038971-bbd3-4004-a837-72efba09b9e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:34 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce
Nov 06 08:38:34 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-4f038971-bbd3-4004-a837-72efba09b9e2" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4f038971-bbd3-4004-a837-72efba09b9e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Deleting offline snapshot 4f038971-bbd3-4004-a837-72efba09b9e2 of volume 5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] snapshot_file for this snap is: volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c75d366-8444-43e7-8db1-38c2adcec410]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:35 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2
Nov 06 08:38:35 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:35 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce" returned: 0 in 0.350s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5aa309-4fc4-4534-af82-69f6952f489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3708c73e-e06c-4103-ab93-e08494f1293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce (eb2d6d48-fa95-48d0-8a5c-913eaca1bdce): created successfully
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3708c73e-e06c-4103-ab93-e08494f1293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (37fbb452-c5e2-4c3f-b6a0-8e461b643d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:35 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a3f9a988-9438-40e5-985d-243d2cf9bf9b tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created volume successfully.
Nov 06 08:38:35 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2" returned: 0 in 0.446s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dda629-e40c-41ba-b614-36bb0d2de8c5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:35 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08
Nov 06 08:38:35 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:35 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:36 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2
Nov 06 08:38:36 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:36 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2" returned: 0 in 0.448s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:36 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2
Nov 06 08:38:36 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:36 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08.4f038971-bbd3-4004-a837-72efba09b9e2" returned: 0 in 0.352s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4f038971-bbd3-4004-a837-72efba09b9e2" released by "_delete_snapshot" :: held 1.829s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" released by "delete_snapshot" :: held 1.861s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (cd4c7397-7d26-4205-b3e1-79881e267d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94630d0f-7dab-4799-94c2-f816273f78ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:36 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Created reservations ['42cd0ab5-bfe1-4699-b12e-0704dfd62c07', '6c54b792-f40c-4605-bfb1-6922be861fb8', '730eeaf2-6ab7-4815-a009-c9a428137c3c', '5a95850b-d790-4733-bd6a-97e674415cdf'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94630d0f-7dab-4799-94c2-f816273f78ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897816414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1f1f8b-74ff-40a0-8703-fe56971c1c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:37Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db05074a-86d4-44f7-94e8-3189b1f8c3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db05074a-86d4-44f7-94e8-3189b1f8c3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ed5e64-7ac3-426a-8d62-abbd643cad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ed5e64-7ac3-426a-8d62-abbd643cad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1f1f8b-74ff-40a0-8703-fe56971c1c6a', 'volume_name': 'volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e2366b-1c42-4fe4-a406-a14a75f2a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e2366b-1c42-4fe4-a406-a14a75f2a73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca535d3-21d3-48b3-bada-bab8a816ca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume 4d1f1f8b-74ff-40a0-8703-fe56971c1c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a', 'volume_size': 1}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897816414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1f1f8b-74ff-40a0-8703-fe56971c1c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:37Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Creating volume 4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:37 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:37 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a 1073741824
Nov 06 08:38:37 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:37 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Delete snapshot completed successfully.
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (f6ebf8a2-8b09-4196-95ac-4fefa93f5a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1970dd86-2d20-4153-9b22-7452aac7a483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-feb19a6a-986f-40c8-8f9e-e7b8626dfce2 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-4f038971-bbd3-4004-a837-72efba09b9e2-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1970dd86-2d20-4153-9b22-7452aac7a483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140942534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43137a2d-4d08-413e-b5b4-78c613599f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:37Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347eb25b-ba63-47b7-b76f-bca8e2ab595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347eb25b-ba63-47b7-b76f-bca8e2ab595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4b10ea-d15d-4338-9e5f-985da00434fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4b10ea-d15d-4338-9e5f-985da00434fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43137a2d-4d08-413e-b5b4-78c613599f81', 'volume_name': 'volume-43137a2d-4d08-413e-b5b4-78c613599f81', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1787695e-9836-4844-9c86-7c1863d7dcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1787695e-9836-4844-9c86-7c1863d7dcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e6b94a-d4f1-4df9-a3a8-23908fb7dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume 43137a2d-4d08-413e-b5b4-78c613599f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43137a2d-4d08-413e-b5b4-78c613599f81', 'volume_size': 1}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (c5d507f2-5b29-45a3-97ea-6839f848327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba824cb3-cf2d-4f71-a7c5-c2f0a06797a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba824cb3-cf2d-4f71-a7c5-c2f0a06797a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-484948023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54070bd-dcbd-460f-9789-417bb8dc38a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:37Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46138369-c63e-4717-b074-0e676adb2702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46138369-c63e-4717-b074-0e676adb2702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54991935-9e1c-4b24-b953-48ad886a7f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54991935-9e1c-4b24-b953-48ad886a7f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54070bd-dcbd-460f-9789-417bb8dc38a7', 'volume_name': 'volume-b54070bd-dcbd-460f-9789-417bb8dc38a7', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9065c408-0c59-4e43-ad15-b1be23070969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9065c408-0c59-4e43-ad15-b1be23070969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b202c136-a736-4fb1-9549-cbd21386dd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume b54070bd-dcbd-460f-9789-417bb8dc38a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54070bd-dcbd-460f-9789-417bb8dc38a7', 'volume_size': 1}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:37 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a 1073741824" returned: 0 in 0.705s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:37 devstack sudo[106971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a
Nov 06 08:38:37 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (3f08569f-fee9-4748-bbad-15886fe88cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7685839b-05a6-44f3-a665-6d57c72d5366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7685839b-05a6-44f3-a665-6d57c72d5366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-274733839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b9a2e6-e1de-47ac-90f5-e011154e3b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:38Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa2e1ef-f2e1-4ab3-a0f6-743ddba144bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa2e1ef-f2e1-4ab3-a0f6-743ddba144bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f271192-d6bb-4566-9004-a1c832775172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:37 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f271192-d6bb-4566-9004-a1c832775172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b9a2e6-e1de-47ac-90f5-e011154e3b8b', 'volume_name': 'volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52787bd1-0d18-4e2a-bd91-04c8e0e240d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52787bd1-0d18-4e2a-bd91-04c8e0e240d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873f0f8a-09af-4abc-a156-6f8c3017eefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume e9b9a2e6-e1de-47ac-90f5-e011154e3b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b', 'volume_size': 1}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:38 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140942534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43137a2d-4d08-413e-b5b4-78c613599f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:37Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Creating volume 43137a2d-4d08-413e-b5b4-78c613599f81 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:38 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:38 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81 1073741824
Nov 06 08:38:38 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca535d3-21d3-48b3-bada-bab8a816ca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb38f6f-f12c-4c55-b871-ad6620fafe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:38 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a (4d1f1f8b-74ff-40a0-8703-fe56971c1c6a): created successfully
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb38f6f-f12c-4c55-b871-ad6620fafe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (cd4c7397-7d26-4205-b3e1-79881e267d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c3f87ec7-a349-452b-9820-bdb5aa4d5408 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created volume successfully.
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff2dc1d-72db-4621-a55f-56af81b1fa2e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (82cfe034-b2c1-441b-869b-cf864571b4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7594e13f-66cc-40c1-952b-45d626f0df82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7594e13f-66cc-40c1-952b-45d626f0df82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245432947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5a32a0-04b6-4374-98a1-d1e09500bb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:38Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b456b0a-b5a7-443e-980b-c60559f97168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b456b0a-b5a7-443e-980b-c60559f97168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4957d53-6bf7-45c4-824d-6614d1b33702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4957d53-6bf7-45c4-824d-6614d1b33702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b5a32a0-04b6-4374-98a1-d1e09500bb82', 'volume_name': 'volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7686b9-cb94-4ce8-b342-fe0da4a58fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7686b9-cb94-4ce8-b342-fe0da4a58fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb7f099-01e4-49da-b12d-425aece903af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:38 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume 8b5a32a0-04b6-4374-98a1-d1e09500bb82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82', 'volume_size': 1}
Nov 06 08:38:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:39 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81 1073741824" returned: 0 in 0.838s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:39 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (5ef028d7-3d06-411c-83e6-7e2a11d0ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be84568b-2f17-4a61-b706-ca94479cdf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" returned: 0 in 0.581s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be84568b-2f17-4a61-b706-ca94479cdf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365274845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a379966e-f41e-4737-83a5-8c542cc231f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:39Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:39 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280bcd47-207d-4357-8feb-3519470f2d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:39 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280bcd47-207d-4357-8feb-3519470f2d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fbfd1d-70ca-4a11-b6f1-e37a2c8e554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fbfd1d-70ca-4a11-b6f1-e37a2c8e554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a379966e-f41e-4737-83a5-8c542cc231f2', 'volume_name': 'volume-a379966e-f41e-4737-83a5-8c542cc231f2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e77560d-82a2-41ec-8189-2a7bf1b62b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e77560d-82a2-41ec-8189-2a7bf1b62b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a770be93-32f7-4560-8385-da1f65547423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:39 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume a379966e-f41e-4737-83a5-8c542cc231f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a379966e-f41e-4737-83a5-8c542cc231f2', 'volume_size': 1}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:39 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81
Nov 06 08:38:39 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:39 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" returned: 0 in 0.326s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08" released by "delete_volume" :: held 1.047s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:39 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81" returned: 0 in 0.303s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-484948023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54070bd-dcbd-460f-9789-417bb8dc38a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:37Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Creating volume b54070bd-dcbd-460f-9789-417bb8dc38a7 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:39 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:39 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7 1073741824
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e6b94a-d4f1-4df9-a3a8-23908fb7dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43137a2d-4d08-413e-b5b4-78c613599f81', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:39 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0691bb81-46dc-4bea-8f0f-92b3918b4897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Created reservations ['97f0ec65-709a-4a69-b59c-195127a67d37', '84d81d54-8b2d-4a76-9dc6-532618f9ae92', '49415986-3042-4f66-bb22-7ddd0480085c', 'e1029f51-e368-4828-a639-7e0e42fae9ed'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:39 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume volume-43137a2d-4d08-413e-b5b4-78c613599f81 (43137a2d-4d08-413e-b5b4-78c613599f81): created successfully
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0691bb81-46dc-4bea-8f0f-92b3918b4897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (f6ebf8a2-8b09-4196-95ac-4fefa93f5a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-11ba2dc7-6021-4e71-9a0d-6fe4664037eb tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created volume successfully.
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:39 devstack sudo[106994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:39 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:39 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.293s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:39 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Deleted volume successfully.
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7511eee6-090a-4964-a148-61a67ccc7494 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-5a0c8c2e-e296-46c0-a4e3-3e889a0e8a08-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:40 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7 1073741824" returned: 0 in 0.498s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:40 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7
Nov 06 08:38:40 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:40 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-274733839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b9a2e6-e1de-47ac-90f5-e011154e3b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:38Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Creating volume e9b9a2e6-e1de-47ac-90f5-e011154e3b8b {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:40 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b202c136-a736-4fb1-9549-cbd21386dd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54070bd-dcbd-460f-9789-417bb8dc38a7', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:40 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b 1073741824
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e092f2-4cf2-4433-84cf-fd3adfb9859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:40 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:40 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume volume-b54070bd-dcbd-460f-9789-417bb8dc38a7 (b54070bd-dcbd-460f-9789-417bb8dc38a7): created successfully
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e092f2-4cf2-4433-84cf-fd3adfb9859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (c5d507f2-5b29-45a3-97ea-6839f848327c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:40 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f391b3b0-4bc1-4cf9-93c5-df841d47e896 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created volume successfully.
Nov 06 08:38:40 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b 1073741824" returned: 0 in 0.520s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:40 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b
Nov 06 08:38:40 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (2866d38b-0280-45a8-bf04-5fa52db3db35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3a1570-5746-4876-96d8-eb8ea7d9b974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3a1570-5746-4876-96d8-eb8ea7d9b974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115408283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de62e5c1-9a13-4e5d-99c1-4e032ef3cfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:41Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b5028d-b57b-4bc7-93d8-faf3f97ff46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:41 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b5028d-b57b-4bc7-93d8-faf3f97ff46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e03ed8-08ae-4e1b-b65e-47b3fb5cf3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e03ed8-08ae-4e1b-b65e-47b3fb5cf3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de62e5c1-9a13-4e5d-99c1-4e032ef3cfad', 'volume_name': 'volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c2b333-6c5c-4104-a7a2-158fdbd25564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c2b333-6c5c-4104-a7a2-158fdbd25564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421e4b02-1e82-4c00-8f95-c959496ff4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:41 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Volume de62e5c1-9a13-4e5d-99c1-4e032ef3cfad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad', 'volume_size': 1}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b" returned: 0 in 0.421s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.537s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245432947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5a32a0-04b6-4374-98a1-d1e09500bb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:38Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Creating volume 8b5a32a0-04b6-4374-98a1-d1e09500bb82 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:41 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873f0f8a-09af-4abc-a156-6f8c3017eefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:41 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82 1073741824
Nov 06 08:38:41 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc7c98f-bf5f-4c01-a6ca-8b4c7a5f4aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:41 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b (e9b9a2e6-e1de-47ac-90f5-e011154e3b8b): created successfully
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc7c98f-bf5f-4c01-a6ca-8b4c7a5f4aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (3f08569f-fee9-4748-bbad-15886fe88cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d4e83b25-f825-4531-a717-5017052785ff tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created volume successfully.
Nov 06 08:38:41 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82 1073741824" returned: 0 in 0.434s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:41 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82
Nov 06 08:38:41 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:42 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.858s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365274845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a379966e-f41e-4737-83a5-8c542cc231f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de0bcdb86147318526eba8a2bbb261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:39Z,use_quota=True,user_id='d787374460c748e09f56a5b6f9ed82c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Creating volume a379966e-f41e-4737-83a5-8c542cc231f2 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:42 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb7f099-01e4-49da-b12d-425aece903af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dff6ee4-66d2-4d3d-bdd6-1a3afa1acf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:42 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2 1073741824
Nov 06 08:38:42 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:42 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82 (8b5a32a0-04b6-4374-98a1-d1e09500bb82): created successfully
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dff6ee4-66d2-4d3d-bdd6-1a3afa1acf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (82cfe034-b2c1-441b-869b-cf864571b4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2656979d-c513-4570-96bf-0b1e66b5fba6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created volume successfully.
Nov 06 08:38:42 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2 1073741824" returned: 0 in 0.491s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:42 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2
Nov 06 08:38:42 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:42 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.564s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a770be93-32f7-4560-8385-da1f65547423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a379966e-f41e-4737-83a5-8c542cc231f2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb50929-af22-4ce2-bbbe-9f6564c789c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Creating offline snapshot ef6c4fd2-24ba-4a79-8429-e09ee63acee6 of volume 4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:38:42 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Volume volume-a379966e-f41e-4737-83a5-8c542cc231f2 (a379966e-f41e-4737-83a5-8c542cc231f2): created successfully
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb50929-af22-4ce2-bbbe-9f6564c789c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Flow 'volume_create_manager' (5ef028d7-3d06-411c-83e6-7e2a11d0ae01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e26d1a-41c9-4394-8aa3-3a98fcb00274]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-53966ad8-74ae-4818-b249-64f0424e35f6 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created volume successfully.
Nov 06 08:38:43 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a
Nov 06 08:38:43 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:43 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" returned: 0 in 0.377s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:43 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 1G
Nov 06 08:38:43 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-a379966e-f41e-4737-83a5-8c542cc231f2-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-a379966e-f41e-4737-83a5-8c542cc231f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-quobyte-a379966e-f41e-4737-83a5-8c542cc231f2" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-a379966e-f41e-4737-83a5-8c542cc231f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ae315-2b2f-4576-9f97-b8a8bcf3647b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Flow 'volume_create_manager' (1b7471f6-d381-4b37-af79-0447cf71850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defcad25-7358-45b3-b231-c68cc356d7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:43 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defcad25-7358-45b3-b231-c68cc356d7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-994411111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a60e3b9-7136-4aff-b479-f58b482fc52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09d9e90045d4df68b047cd45d196203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:44Z,use_quota=True,user_id='135e42d232864ea08d7c127affc513a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924d4054-a16d-4cea-9770-9fe20e9eff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924d4054-a16d-4cea-9770-9fe20e9eff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29208bb-612b-430a-8d4f-8383426c3eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29208bb-612b-430a-8d4f-8383426c3eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a60e3b9-7136-4aff-b479-f58b482fc52b', 'volume_name': 'volume-5a60e3b9-7136-4aff-b479-f58b482fc52b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:43 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd831c3f-e407-4510-a82b-2f52736fedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:43 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd831c3f-e407-4510-a82b-2f52736fedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a98589-5011-482a-8a26-8f8de1aaae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:43 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Volume 5a60e3b9-7136-4aff-b479-f58b482fc52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a60e3b9-7136-4aff-b479-f58b482fc52b', 'volume_size': 1}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 1G" returned: 0 in 0.524s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:43 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6
Nov 06 08:38:43 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:44 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2
Nov 06 08:38:44 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6" returned: 0 in 0.293s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:44 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 is being set with open permissions: ugo+rw
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:44 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6
Nov 06 08:38:44 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-a379966e-f41e-4737-83a5-8c542cc231f2" returned: 0 in 0.251s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-a379966e-f41e-4737-83a5-8c542cc231f2" released by "delete_volume" :: held 0.683s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:44 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6" returned: 0 in 0.262s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created reservations ['f2b28f6d-c434-4b16-a295-23f2aba53f0f', '4b0f6434-008c-421b-a818-1faa6de80385', '1d4664a6-ea95-4d96-bc15-c5f4e48eb497', '0403cdf5-82dc-4902-8b41-b923eaad0848'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:44 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.info
Nov 06 08:38:44 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:44 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:44 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.info" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:44 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.info is being set with open permissions: ugo+rw
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:44 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.info
Nov 06 08:38:44 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-8b5a32a0-04b6-4374-98a1-d1e09500bb82-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.277s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:44 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Deleted volume successfully.
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-8b5a32a0-04b6-4374-98a1-d1e09500bb82-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-cec0bc76-9a14-430a-b671-777c0abd406f tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-a379966e-f41e-4737-83a5-8c542cc231f2-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-quobyte-8b5a32a0-04b6-4374-98a1-d1e09500bb82" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-8b5a32a0-04b6-4374-98a1-d1e09500bb82" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b20840-76e3-41a1-b00d-68ae181fecd9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:44 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.info" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.638s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115408283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de62e5c1-9a13-4e5d-99c1-4e032ef3cfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:41Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Creating volume de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:44 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:44 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82
Nov 06 08:38:44 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad 1073741824
Nov 06 08:38:44 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:44 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-608825e5-1ace-4ddd-9163-1d70f44fded7 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Create snapshot completed successfully
Nov 06 08:38:45 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82" returned: 0 in 0.384s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:45 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82
Nov 06 08:38:45 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:45 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad 1073741824" returned: 0 in 0.443s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:45 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad
Nov 06 08:38:45 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:45 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8b5a32a0-04b6-4374-98a1-d1e09500bb82" returned: 0 in 0.268s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-8b5a32a0-04b6-4374-98a1-d1e09500bb82" released by "delete_volume" :: held 0.697s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created reservations ['fa12fa94-3cda-47d4-9990-cdefa869ccd4', 'a9ca8b44-3364-4ad5-87a8-ce2505a2cf6d', '62774479-2743-463b-8e2a-d182a88d59d6', 'e01eda7f-8ee9-458b-860d-f0092bd0e8b9'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:45 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:45 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:45 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-994411111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a60e3b9-7136-4aff-b479-f58b482fc52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09d9e90045d4df68b047cd45d196203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:44Z,use_quota=True,user_id='135e42d232864ea08d7c127affc513a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Creating volume 5a60e3b9-7136-4aff-b479-f58b482fc52b {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:45 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421e4b02-1e82-4c00-8f95-c959496ff4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:45 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b 1073741824
Nov 06 08:38:45 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a134697-4d7d-4296-a70f-f0f60259645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:45 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Volume volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad (de62e5c1-9a13-4e5d-99c1-4e032ef3cfad): created successfully
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a134697-4d7d-4296-a70f-f0f60259645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (2866d38b-0280-45a8-bf04-5fa52db3db35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d8292879-94e5-4540-aa04-e34ecbfd849b tempest-ProjectReaderTests-1513806032 None] Created volume successfully.
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:46 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.366s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:46 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Deleted volume successfully.
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-quobyte-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fb6b6924-bb97-4afc-ae60-43ae51daf305 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-8b5a32a0-04b6-4374-98a1-d1e09500bb82-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd92d15-d874-45ab-83a4-9819c6f30f72]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (7996ed2c-fbf6-426f-b0fe-3ca65de44498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d126d98-5f8c-4e0e-80ab-aada2d998822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d126d98-5f8c-4e0e-80ab-aada2d998822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-985409095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e382d050-d69c-4530-8257-c110cf575fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:46Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4569d763-4135-47f9-bf72-dfa95fc19342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4569d763-4135-47f9-bf72-dfa95fc19342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff898eac-b4ee-419f-bf0a-65006b4b6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff898eac-b4ee-419f-bf0a-65006b4b6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e382d050-d69c-4530-8257-c110cf575fb6', 'volume_name': 'volume-e382d050-d69c-4530-8257-c110cf575fb6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318f3b07-58f9-4441-a25d-a2afba024161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b
Nov 06 08:38:46 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318f3b07-58f9-4441-a25d-a2afba024161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16fcc83-b39b-443f-aaf1-324c5d0bca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume e382d050-d69c-4530-8257-c110cf575fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e382d050-d69c-4530-8257-c110cf575fb6', 'volume_size': 1}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:46 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b 1073741824" returned: 0 in 0.726s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:46 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b
Nov 06 08:38:46 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (7f837910-094a-4e98-b61f-e97b06db6ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a97f42-512d-4a2f-b1d9-9e3a524cc0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a97f42-512d-4a2f-b1d9-9e3a524cc0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50011353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648e7dfb-783a-487d-a046-c55cfe6def48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:46Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45969068-9e5d-4c03-8f5e-0cdca3ed0b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45969068-9e5d-4c03-8f5e-0cdca3ed0b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0189483-5ed1-4b9e-acca-e3b9498ab836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0189483-5ed1-4b9e-acca-e3b9498ab836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648e7dfb-783a-487d-a046-c55cfe6def48', 'volume_name': 'volume-648e7dfb-783a-487d-a046-c55cfe6def48', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db91a8c2-eed5-4e17-ada3-11a6f1f2f182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db91a8c2-eed5-4e17-ada3-11a6f1f2f182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f72d3e3-aac4-4184-af3f-c2c16a27884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume 648e7dfb-783a-487d-a046-c55cfe6def48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648e7dfb-783a-487d-a046-c55cfe6def48', 'volume_size': 1}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:46 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b" returned: 0 in 0.661s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:46 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b
Nov 06 08:38:46 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:46 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b" returned: 0 in 0.335s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-985409095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e382d050-d69c-4530-8257-c110cf575fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:46Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Creating volume e382d050-d69c-4530-8257-c110cf575fb6 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:46 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a98589-5011-482a-8a26-8f8de1aaae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a60e3b9-7136-4aff-b479-f58b482fc52b', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6 1073741824
Nov 06 08:38:46 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9583eace-bcb4-49b2-8fd8-2f25115cdc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Volume volume-5a60e3b9-7136-4aff-b479-f58b482fc52b (5a60e3b9-7136-4aff-b479-f58b482fc52b): created successfully
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9583eace-bcb4-49b2-8fd8-2f25115cdc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Flow 'volume_create_manager' (1b7471f6-d381-4b37-af79-0447cf71850c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (c0020a60-35bb-4230-bbdc-36cc4149f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a030d49-7361-4c10-90d5-ad852d2a1109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-17a048f5-1ed0-4569-9b87-e2ded3e6a2bc tempest-ProjectReaderTests-919584674 None] Created volume successfully.
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a030d49-7361-4c10-90d5-ad852d2a1109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321420702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc4ca46-6473-488f-b572-bba6208bb783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:47Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6736f94-d259-4251-a295-137a5c3eb46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6736f94-d259-4251-a295-137a5c3eb46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9556a89c-c6e2-4a8c-9c33-738366d9d63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9556a89c-c6e2-4a8c-9c33-738366d9d63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc4ca46-6473-488f-b572-bba6208bb783', 'volume_name': 'volume-8bc4ca46-6473-488f-b572-bba6208bb783', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd0f17a-8dbe-43b3-86f6-cf9d071885db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd0f17a-8dbe-43b3-86f6-cf9d071885db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316a36d1-ad94-4c83-8748-f916e3987488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume 8bc4ca46-6473-488f-b572-bba6208bb783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc4ca46-6473-488f-b572-bba6208bb783', 'volume_size': 1}
Nov 06 08:38:47 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b" returned: 0 in 0.410s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b" released by "delete_volume" :: held 1.137s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created reservations ['ab7e4c47-56ee-434b-93f3-a3d3d2954c45', '35c57ace-3b4d-4371-9d76-e76c41030cf9', '9f4f824b-37a2-4a36-a965-96d1538f824f', 'b5f06479-958a-4b45-9d91-8f9468e142a9'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:47 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:47 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:47 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (623ef2d3-528e-4bf0-bbed-06f8a7aa6b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c92a1a-15f8-404b-9965-3318a9cb6050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6 1073741824" returned: 0 in 0.685s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c92a1a-15f8-404b-9965-3318a9cb6050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206590068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2066a4-cdcc-4ee1-add9-6f348a599004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:47Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452cb676-45fb-4cfb-8409-aa595c239999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452cb676-45fb-4cfb-8409-aa595c239999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4272f699-63b2-4253-87d4-c158f8035621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4272f699-63b2-4253-87d4-c158f8035621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed2066a4-cdcc-4ee1-add9-6f348a599004', 'volume_name': 'volume-ed2066a4-cdcc-4ee1-add9-6f348a599004', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bde737-0025-423b-89fa-ba46d8c261a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bde737-0025-423b-89fa-ba46d8c261a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e0797-5fa3-4b8e-9946-8acdef67b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume ed2066a4-cdcc-4ee1-add9-6f348a599004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed2066a4-cdcc-4ee1-add9-6f348a599004', 'volume_size': 1}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:47 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:47 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6
Nov 06 08:38:47 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Deleted volume successfully.
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-fba2c79b-2322-4a4a-a9fd-01f3d8426bfe tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-e9b9a2e6-e1de-47ac-90f5-e011154e3b8b-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:47 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6" returned: 0 in 0.264s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.242s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50011353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648e7dfb-783a-487d-a046-c55cfe6def48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:46Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Creating volume 648e7dfb-783a-487d-a046-c55cfe6def48 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:47 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16fcc83-b39b-443f-aaf1-324c5d0bca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e382d050-d69c-4530-8257-c110cf575fb6', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aadbfa-3ebd-422a-8c85-61dcd909e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:47 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume volume-e382d050-d69c-4530-8257-c110cf575fb6 (e382d050-d69c-4530-8257-c110cf575fb6): created successfully
Nov 06 08:38:47 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48 1073741824
Nov 06 08:38:47 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aadbfa-3ebd-422a-8c85-61dcd909e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:47 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (7996ed2c-fbf6-426f-b0fe-3ca65de44498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4c8eaf83-428c-4444-b22b-c604bc668ff4 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created volume successfully.
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (ce98b727-160b-4a57-8707-570b95415a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d976ce6d-bc6e-4866-81df-d8f704a15d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d976ce6d-bc6e-4866-81df-d8f704a15d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877598001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e9ee9c-ef78-421c-8c3b-ef852cb70b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:48Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ff396e-a1d0-4fd5-b311-847a22727bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ff396e-a1d0-4fd5-b311-847a22727bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258efd1c-cdb5-4903-81d8-19b37cd32bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258efd1c-cdb5-4903-81d8-19b37cd32bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e9ee9c-ef78-421c-8c3b-ef852cb70b8e', 'volume_name': 'volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa03825d-4780-4bdf-9e02-2878feeb7e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa03825d-4780-4bdf-9e02-2878feeb7e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946e1050-8f7b-45c3-aa3c-0c80cdb6ae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume 04e9ee9c-ef78-421c-8c3b-ef852cb70b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e', 'volume_size': 1}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Acquiring lock "cinder-5a60e3b9-7136-4aff-b479-f58b482fc52b-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Lock "cinder-5a60e3b9-7136-4aff-b479-f58b482fc52b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Acquiring lock "cinder-quobyte-5a60e3b9-7136-4aff-b479-f58b482fc52b" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Lock "cinder-quobyte-5a60e3b9-7136-4aff-b479-f58b482fc52b" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-b54070bd-dcbd-460f-9789-417bb8dc38a7-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9abe4-728a-4132-a0fe-ebc909353c96]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-b54070bd-dcbd-460f-9789-417bb8dc38a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-quobyte-b54070bd-dcbd-460f-9789-417bb8dc38a7" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-b54070bd-dcbd-460f-9789-417bb8dc38a7" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[869791e6-38ef-45ec-999c-113f7651649a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:48 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b
Nov 06 08:38:48 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:48 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48 1073741824" returned: 0 in 0.540s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:48 devstack sudo[107127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48
Nov 06 08:38:48 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:48 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7
Nov 06 08:38:48 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:48 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b" returned: 0 in 0.415s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:48 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b
Nov 06 08:38:48 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:48 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48" returned: 0 in 0.274s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.077s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Creating offline snapshot 0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 of volume de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:38:48 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f72d3e3-aac4-4184-af3f-c2c16a27884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648e7dfb-783a-487d-a046-c55cfe6def48', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d63063-5410-422b-95cd-c6f5c4d5386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7" returned: 0 in 0.412s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5cb86-dcbf-4cb8-a351-204b52613592]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:48 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume volume-648e7dfb-783a-487d-a046-c55cfe6def48 (648e7dfb-783a-487d-a046-c55cfe6def48): created successfully
Nov 06 08:38:48 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7
Nov 06 08:38:48 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d63063-5410-422b-95cd-c6f5c4d5386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:48 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (7f837910-094a-4e98-b61f-e97b06db6ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:48 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3a98d0cb-e82e-4465-9f1e-03345dcf5bbd tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created volume successfully.
Nov 06 08:38:48 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad
Nov 06 08:38:48 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:49 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5a60e3b9-7136-4aff-b479-f58b482fc52b" returned: 0 in 0.299s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Lock "cinder-quobyte-5a60e3b9-7136-4aff-b479-f58b482fc52b" released by "delete_volume" :: held 0.784s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:49 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b54070bd-dcbd-460f-9789-417bb8dc38a7" returned: 0 in 0.289s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Created reservations ['d25d758f-a259-43fc-b1be-b1d3112715d4', 'f569a5d0-fd88-4a8b-94d8-40b259274c13', '0d4a8db7-b5c3-47c8-8d28-892edfa0a995', '647ddd0f-c5c8-4397-88f4-b90ba8afadae'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-b54070bd-dcbd-460f-9789-417bb8dc38a7" released by "delete_volume" :: held 0.746s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created reservations ['771dde25-f3e3-4432-a557-c3ba3082cb04', 'bc739b9d-dffa-4105-80cb-5d58c904259c', 'f394ddb8-6586-4858-8423-b4d85b8c5790', 'b47f3526-838f-43f4-9858-f8dec000e381'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:49 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" returned: 0 in 0.446s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:49 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:49 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:49 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 1G
Nov 06 08:38:49 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:49 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:49 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-43137a2d-4d08-413e-b5b4-78c613599f81-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-43137a2d-4d08-413e-b5b4-78c613599f81-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-quobyte-43137a2d-4d08-413e-b5b4-78c613599f81" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-43137a2d-4d08-413e-b5b4-78c613599f81" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f89e8b-d411-41e9-959b-82d1ddb006cd]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:49 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.448s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Deleted volume successfully.
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-3a12cf6e-3d2b-420a-8464-3f43517c39c6 tempest-ProjectReaderTests-919584674 None] Lock "cinder-5a60e3b9-7136-4aff-b479-f58b482fc52b-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:49 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.441s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Deleted volume successfully.
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e874228-121d-46a3-a366-0e81e83fef36 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-b54070bd-dcbd-460f-9789-417bb8dc38a7-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:49 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81
Nov 06 08:38:49 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:49 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 1G" returned: 0 in 0.653s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:49 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8
Nov 06 08:38:49 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Flow 'volume_create_manager' (4c13fc0e-811c-4b84-ac4d-a341b7f3ebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad96bb13-91c9-4537-a42c-32a20766adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad96bb13-91c9-4537-a42c-32a20766adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103886742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0844c7b-d857-40f5-94de-f31af4906030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09d9e90045d4df68b047cd45d196203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:50Z,use_quota=True,user_id='135e42d232864ea08d7c127affc513a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76220665-90f5-4922-a37e-5b5a553a2c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76220665-90f5-4922-a37e-5b5a553a2c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c194ee8a-9754-452f-b364-2cb26352c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c194ee8a-9754-452f-b364-2cb26352c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0844c7b-d857-40f5-94de-f31af4906030', 'volume_name': 'volume-b0844c7b-d857-40f5-94de-f31af4906030', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d68bc96-15a2-42fb-9871-59a750474933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d68bc96-15a2-42fb-9871-59a750474933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94dbcd47-c18d-479c-b0d1-8fbdf1e9e280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:50 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Volume b0844c7b-d857-40f5-94de-f31af4906030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0844c7b-d857-40f5-94de-f31af4906030', 'volume_size': 1}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:50 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81" returned: 0 in 0.443s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:50 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81
Nov 06 08:38:50 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:50 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" returned: 0 in 0.313s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:50 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 is being set with open permissions: ugo+rw
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:50 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8
Nov 06 08:38:50 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:50 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-43137a2d-4d08-413e-b5b4-78c613599f81" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-43137a2d-4d08-413e-b5b4-78c613599f81" released by "delete_volume" :: held 0.777s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created reservations ['3ca67f01-4fc4-4fb2-addc-10d83f77b099', '884a39b7-58e8-454d-8191-215f579719c9', '33814916-4c1b-4632-96db-ac36db79688b', 'b8eda009-a3a5-4641-abf2-b833f4e27b07'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:50 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" returned: 0 in 0.259s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:50 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:50 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:50 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.info
Nov 06 08:38:50 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:50 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "cinder-quobyte-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.271s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Deleted volume successfully.
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-853b30e7-6d79-4456-8f41-d30ea037e465 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-43137a2d-4d08-413e-b5b4-78c613599f81-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f20ffcc-b265-4c15-a53a-ad58ee97e5df]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:50 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.info" returned: 0 in 0.303s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:50 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.info is being set with open permissions: ugo+rw
Nov 06 08:38:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:50 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.info
Nov 06 08:38:50 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:50 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce
Nov 06 08:38:50 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:51 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.info" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321420702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc4ca46-6473-488f-b572-bba6208bb783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:47Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Creating volume 8bc4ca46-6473-488f-b572-bba6208bb783 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:51 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:51 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783 1073741824
Nov 06 08:38:51 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:51 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-130cb2f9-3397-4a6e-92f6-a11944cf59f4 tempest-ProjectReaderTests-1513806032 None] Create snapshot completed successfully
Nov 06 08:38:51 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce" returned: 0 in 0.399s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:51 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce
Nov 06 08:38:51 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:51 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce" returned: 0 in 0.274s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-quobyte-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce" released by "delete_volume" :: held 0.725s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Created reservations ['b1a7a359-83e9-4d70-831b-7dec3dace7a9', '5c53bc60-6d60-4182-abeb-d6ca81d8c7c3', '740078a9-f535-4baa-9fbf-73225f90bb4d', '7ff383ec-e535-4e40-a847-4062fe3e9591'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:51 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783 1073741824" returned: 0 in 0.457s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:51 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783
Nov 06 08:38:51 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:51 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:51 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:51 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783" returned: 0 in 0.286s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.298s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206590068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2066a4-cdcc-4ee1-add9-6f348a599004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:47Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Creating volume ed2066a4-cdcc-4ee1-add9-6f348a599004 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:51 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:51 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.302s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:51 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Deleted volume successfully.
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316a36d1-ad94-4c83-8748-f916e3987488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc4ca46-6473-488f-b572-bba6208bb783', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:51 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004 1073741824
Nov 06 08:38:51 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbf253e-13ea-40de-a729-ef8a056b2127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:51 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume volume-8bc4ca46-6473-488f-b572-bba6208bb783 (8bc4ca46-6473-488f-b572-bba6208bb783): created successfully
Nov 06 08:38:51 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbf253e-13ea-40de-a729-ef8a056b2127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (c0020a60-35bb-4230-bbdc-36cc4149f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f9345486-0020-4f8f-b71c-0d2972fe05d4 tempest-CreateVolumesFromSourceVolumeTest-1728790527 None] Lock "cinder-eb2d6d48-fa95-48d0-8a5c-913eaca1bdce-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-c682d459-8a3f-4439-9ff5-63457607306d tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created volume successfully.
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-0e08811b-8c22-4b7d-bb1d-c2aea0026ff8-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Lock "cinder-0e08811b-8c22-4b7d-bb1d-c2aea0026ff8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Deleting offline snapshot 0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 of volume de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] snapshot_file for this snap is: volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ec974-106a-4057-a630-0a650dfd2ef1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:52 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8
Nov 06 08:38:52 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:52 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004 1073741824" returned: 0 in 0.583s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:52 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004
Nov 06 08:38:52 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:52 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" returned: 0 in 0.461s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e5783-17c4-4b58-9095-1b2f6439eaad]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:52 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad
Nov 06 08:38:52 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:52 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004" returned: 0 in 0.272s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.648s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877598001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e9ee9c-ef78-421c-8c3b-ef852cb70b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eefbf0b3d44c41a0f05870ef884113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:48Z,use_quota=True,user_id='8913e83b5fb440fb9b4ce555f51e98a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Creating volume 04e9ee9c-ef78-421c-8c3b-ef852cb70b8e {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:52 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e0797-5fa3-4b8e-9946-8acdef67b34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2066a4-cdcc-4ee1-add9-6f348a599004', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf724406-d5a9-499c-b474-f43d3ef03e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:52 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e 1073741824
Nov 06 08:38:52 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:52 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume volume-ed2066a4-cdcc-4ee1-add9-6f348a599004 (ed2066a4-cdcc-4ee1-add9-6f348a599004): created successfully
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf724406-d5a9-499c-b474-f43d3ef03e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (623ef2d3-528e-4bf0-bbed-06f8a7aa6b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-13987e5e-13d9-4a6b-b86a-fabd52071884 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created volume successfully.
Nov 06 08:38:53 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" returned: 0 in 0.502s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:53 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8
Nov 06 08:38:53 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:53 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e 1073741824" returned: 0 in 0.601s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:53 devstack sudo[107238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e
Nov 06 08:38:53 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:53 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" returned: 0 in 0.446s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:53 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8
Nov 06 08:38:53 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:53 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e" returned: 0 in 0.269s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.730s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103886742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0844c7b-d857-40f5-94de-f31af4906030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09d9e90045d4df68b047cd45d196203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:50Z,use_quota=True,user_id='135e42d232864ea08d7c127affc513a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Creating volume b0844c7b-d857-40f5-94de-f31af4906030 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:53 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:53 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030 1073741824
Nov 06 08:38:53 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946e1050-8f7b-45c3-aa3c-0c80cdb6ae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3ad746-4519-49a0-b8e8-a1664de9dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:53 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Volume volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e (04e9ee9c-ef78-421c-8c3b-ef852cb70b8e): created successfully
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3ad746-4519-49a0-b8e8-a1664de9dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Flow 'volume_create_manager' (ce98b727-160b-4a57-8707-570b95415a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:53 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ff4bfa79-7f89-40e4-9e8b-5e435caa9c80 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created volume successfully.
Nov 06 08:38:53 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad.0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" returned: 0 in 0.272s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-0e08811b-8c22-4b7d-bb1d-c2aea0026ff8" released by "_delete_snapshot" :: held 1.815s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" released by "delete_snapshot" :: held 1.842s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Created reservations ['0a67abe0-7c26-4c4b-9288-5dddec99dcfc', 'f2af5f84-3291-4a6a-942f-e9263c8c6c79', '9986d95d-ae44-45d0-9f27-b93a0e977c27', '7fb061da-47bd-4b0b-8930-49d19eedfd10'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Delete snapshot completed successfully.
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a9e6942a-91b8-4b48-bb8a-77e99263525e tempest-ProjectReaderTests-1513806032 None] Lock "cinder-0e08811b-8c22-4b7d-bb1d-c2aea0026ff8-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Lock "cinder-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:54 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030 1073741824" returned: 0 in 0.543s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[72921dc6-9149-458a-ae89-a58ff019cfe0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:54 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030
Nov 06 08:38:54 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:54 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad
Nov 06 08:38:54 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:54 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030" returned: 0 in 0.257s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94dbcd47-c18d-479c-b0d1-8fbdf1e9e280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0844c7b-d857-40f5-94de-f31af4906030', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ee98bc-67a9-434a-aae9-df9087469682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:54 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Volume volume-b0844c7b-d857-40f5-94de-f31af4906030 (b0844c7b-d857-40f5-94de-f31af4906030): created successfully
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ee98bc-67a9-434a-aae9-df9087469682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Flow 'volume_create_manager' (4c13fc0e-811c-4b84-ac4d-a341b7f3ebb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-42122a4a-4dd0-4898-b722-3a4e1142e270 tempest-ProjectReaderTests-919584674 None] Created volume successfully.
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:54 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" returned: 0 in 0.438s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73547e-58c7-4ec1-ac4e-ff945315203e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:54 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad
Nov 06 08:38:54 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:54 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e
Nov 06 08:38:55 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:55 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" returned: 0 in 0.270s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad" released by "delete_volume" :: held 0.792s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Created reservations ['a8ebe686-cfbb-47aa-8e50-3b14b0a2f40f', 'a805fdde-f0ea-443d-9ad3-282aeabcfd6d', 'dc61b927-9acf-4679-b584-490e3ff956e6', '9707b4ab-0d30-411c-9dae-85d0af9d3e5d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Acquiring lock "cinder-b0844c7b-d857-40f5-94de-f31af4906030-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:55 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e" returned: 0 in 0.484s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Lock "cinder-b0844c7b-d857-40f5-94de-f31af4906030-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:55 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:55 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:55 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e
Nov 06 08:38:55 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Flow 'volume_create_manager' (2dfe11e6-9c31-4e20-b9d3-4ff7b62e8a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faacad6-a91f-44da-86c9-03ed3e615386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Acquiring lock "cinder-quobyte-b0844c7b-d857-40f5-94de-f31af4906030" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faacad6-a91f-44da-86c9-03ed3e615386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-175557834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79efd4be-cceb-4891-90f1-6f420cf5f580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3574a264ca4d1e927df6587148ed03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:55Z,use_quota=True,user_id='d1429a36e11742b1987d7924573c4122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f04cd1-f7a3-4763-9fb7-3fb07ae1c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f04cd1-f7a3-4763-9fb7-3fb07ae1c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4476c955-c718-4dea-872e-92b30132a5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4476c955-c718-4dea-872e-92b30132a5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79efd4be-cceb-4891-90f1-6f420cf5f580', 'volume_name': 'volume-79efd4be-cceb-4891-90f1-6f420cf5f580', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f45da95-65ff-4877-9b2f-d769af4b0edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f45da95-65ff-4877-9b2f-d769af4b0edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a09da-eacb-4489-83fa-035532231075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:55 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Volume 79efd4be-cceb-4891-90f1-6f420cf5f580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79efd4be-cceb-4891-90f1-6f420cf5f580', 'volume_size': 1}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-175557834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79efd4be-cceb-4891-90f1-6f420cf5f580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3574a264ca4d1e927df6587148ed03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:55Z,use_quota=True,user_id='d1429a36e11742b1987d7924573c4122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Creating volume 79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:55 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Lock "cinder-quobyte-b0844c7b-d857-40f5-94de-f31af4906030" acquired by "delete_volume" :: waited 0.098s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:55 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 1073741824
Nov 06 08:38:55 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7e07f3-e3f5-4d0e-97a1-f54a33587e01]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:55 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e" returned: 0 in 0.305s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e" released by "delete_volume" :: held 0.861s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:55 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.373s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Deleted volume successfully.
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-9f3df00e-837d-4b1b-bcbe-603fdfdb2a6b tempest-ProjectReaderTests-1513806032 None] Lock "cinder-de62e5c1-9a13-4e5d-99c1-4e032ef3cfad-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created reservations ['3b283516-cfb0-45a9-a3f5-38ce0b7810c6', '0acd7e8f-68b8-48ec-939a-1b4167062661', '7ecf6bdc-2641-44e6-8e5e-0ec868b109a6', 'cb9e063f-bfed-474d-b980-547a4c047f9f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:55 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030
Nov 06 08:38:55 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:55 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:55 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-ed2066a4-cdcc-4ee1-add9-6f348a599004-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-ed2066a4-cdcc-4ee1-add9-6f348a599004-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (003e529c-8e95-4739-a3fa-2f6a7ed57421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec0eb09-346a-4429-9bed-e2b74de060ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec0eb09-346a-4429-9bed-e2b74de060ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870548379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77799279-2c5a-4260-84cc-0821c40a4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:56Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b67f269-5439-447a-a745-5648d3df1599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b67f269-5439-447a-a745-5648d3df1599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2495b5-f1ff-4892-bc67-b3d88d90b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2495b5-f1ff-4892-bc67-b3d88d90b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77799279-2c5a-4260-84cc-0821c40a4730', 'volume_name': 'volume-77799279-2c5a-4260-84cc-0821c40a4730', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79eab93-2dff-428f-9c41-76247f9a7954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79eab93-2dff-428f-9c41-76247f9a7954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:56 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a95fbe-c041-4362-8676-6e7c2a070b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:56 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Volume 77799279-2c5a-4260-84cc-0821c40a4730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77799279-2c5a-4260-84cc-0821c40a4730', 'volume_size': 1}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 1073741824" returned: 0 in 0.672s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:56 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030" returned: 0 in 0.629s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-ed2066a4-cdcc-4ee1-add9-6f348a599004" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:56 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:56 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030
Nov 06 08:38:56 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.389s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-ed2066a4-cdcc-4ee1-add9-6f348a599004" acquired by "delete_volume" :: waited 0.042s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Deleted volume successfully.
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7ec3b-937c-47ce-a823-81fd293fde95]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:56 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580
Nov 06 08:38:56 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-7e01a670-a60c-48ac-8cb3-c970b6e27447 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-04e9ee9c-ef78-421c-8c3b-ef852cb70b8e-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:56 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004
Nov 06 08:38:56 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:56 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b0844c7b-d857-40f5-94de-f31af4906030" returned: 0 in 0.269s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Lock "cinder-quobyte-b0844c7b-d857-40f5-94de-f31af4906030" released by "delete_volume" :: held 0.956s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:56 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580" returned: 0 in 0.263s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870548379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77799279-2c5a-4260-84cc-0821c40a4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:38:56Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Creating volume 77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:38:56 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Created reservations ['b30bb44b-fb5f-4f3e-9dbc-aa921a113a08', 'fe3402a0-10c0-43ee-9e02-16649167296d', '4fa22e6e-08d9-4d24-8dc6-a6080be4098d', 'e6618fa2-529f-4246-a03f-1c4266f30a07'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:56 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 1073741824
Nov 06 08:38:56 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a09da-eacb-4489-83fa-035532231075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79efd4be-cceb-4891-90f1-6f420cf5f580', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf6b591-2b83-473e-a4f8-14b455a00018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:56 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Volume volume-79efd4be-cceb-4891-90f1-6f420cf5f580 (79efd4be-cceb-4891-90f1-6f420cf5f580): created successfully
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf6b591-2b83-473e-a4f8-14b455a00018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Flow 'volume_create_manager' (2dfe11e6-9c31-4e20-b9d3-4ff7b62e8a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:56 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-799021e8-d019-44ac-8cd8-bf6b566d887d tempest-VolumeDependencyTests-697695769 None] Created volume successfully.
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:56 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:56 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:56 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004" returned: 0 in 0.442s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:56 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004
Nov 06 08:38:56 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:57 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.266s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Deleted volume successfully.
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-af1b1006-287b-461a-ab25-4f2b44b05ccc tempest-ProjectReaderTests-919584674 None] Lock "cinder-b0844c7b-d857-40f5-94de-f31af4906030-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:57 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-ed2066a4-cdcc-4ee1-add9-6f348a599004" returned: 0 in 0.298s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-ed2066a4-cdcc-4ee1-add9-6f348a599004" released by "delete_volume" :: held 0.800s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:57 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 1073741824" returned: 0 in 0.513s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created reservations ['b99d66c3-7bfe-43da-a01a-85026e7b19bc', 'ab3c663e-bebb-44d9-bd8a-9301ad0aaa50', 'cfa655d0-0543-47ac-8b47-aae256d7ab03', '05cab1c4-bf3b-4a3c-98da-8b70876d6413'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:57 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730
Nov 06 08:38:57 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:57 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:57 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:57 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730" returned: 0 in 0.257s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a95fbe-c041-4362-8676-6e7c2a070b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77799279-2c5a-4260-84cc-0821c40a4730', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bce935-eefb-4061-8796-1564bc8d1047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:38:57 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Volume volume-77799279-2c5a-4260-84cc-0821c40a4730 (77799279-2c5a-4260-84cc-0821c40a4730): created successfully
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bce935-eefb-4061-8796-1564bc8d1047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (003e529c-8e95-4739-a3fa-2f6a7ed57421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:38:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-09b81722-70e0-43ef-8ec9-d641bd4e5166 tempest-ProjectReaderTests-1513806032 None] Created volume successfully.
Nov 06 08:38:57 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.285s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Deleted volume successfully.
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-53ef0e55-b6b7-4e75-aa0f-7f398e2810ea tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-ed2066a4-cdcc-4ee1-add9-6f348a599004-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Creating offline snapshot 981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 of volume 79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc83a1d-e5b7-4623-801b-9759bfe3865a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:57 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580
Nov 06 08:38:57 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:58 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580" returned: 0 in 0.385s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:58 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 1G
Nov 06 08:38:58 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-8bc4ca46-6473-488f-b572-bba6208bb783-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-8bc4ca46-6473-488f-b572-bba6208bb783-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-8bc4ca46-6473-488f-b572-bba6208bb783" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-8bc4ca46-6473-488f-b572-bba6208bb783" acquired by "delete_volume" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac5858c-b3aa-42b4-80e4-2855371893ad]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:58 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783
Nov 06 08:38:58 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:58 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 1G" returned: 0 in 0.636s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79efd4be-cceb-4891-90f1-6f420cf5f580 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:58 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79efd4be-cceb-4891-90f1-6f420cf5f580 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0
Nov 06 08:38:58 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:58 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783" returned: 0 in 0.429s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:58 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783
Nov 06 08:38:58 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:59 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79efd4be-cceb-4891-90f1-6f420cf5f580 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" returned: 0 in 0.325s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:59 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 is being set with open permissions: ugo+rw
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:59 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0
Nov 06 08:38:59 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:59 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8bc4ca46-6473-488f-b572-bba6208bb783" returned: 0 in 0.284s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-8bc4ca46-6473-488f-b572-bba6208bb783" released by "delete_volume" :: held 0.780s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created reservations ['5050b847-a301-4cc0-9b19-51b3dfdbe4a4', 'c41bf454-a271-42c5-898a-825b831c83ac', 'a641d29c-9f49-4ad1-af29-053ddb75dbc1', 'e15d5422-4b63-464e-ba4e-6c31615f6642'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:38:59 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" returned: 0 in 0.285s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:59 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:38:59 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:59 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.info
Nov 06 08:38:59 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-648e7dfb-783a-487d-a046-c55cfe6def48-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-648e7dfb-783a-487d-a046-c55cfe6def48-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-648e7dfb-783a-487d-a046-c55cfe6def48" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-648e7dfb-783a-487d-a046-c55cfe6def48" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[65859d3f-8988-40c9-9c73-514a9ddb8ed9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:59 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.328s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:38:59 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Deleted volume successfully.
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-81b6feea-64e5-41e3-b126-ce5899025817 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-8bc4ca46-6473-488f-b572-bba6208bb783-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:38:59 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.info" returned: 0 in 0.365s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:38:59 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.info is being set with open permissions: ugo+rw
Nov 06 08:38:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:38:59 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.info
Nov 06 08:38:59 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:38:59 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48
Nov 06 08:38:59 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:00 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.info" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.499s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Creating offline snapshot 984f6354-a3b0-4636-ba2b-46951605213d of volume 77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:39:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-45434791-72e4-4d93-b544-b399327f6af7 tempest-VolumeDependencyTests-697695769 None] Create snapshot completed successfully
Nov 06 08:39:00 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cde572-9c37-41d3-95a5-ca0a8feedc7c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48" returned: 0 in 0.448s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:00 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48
Nov 06 08:39:00 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:00 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730
Nov 06 08:39:00 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:00 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-648e7dfb-783a-487d-a046-c55cfe6def48" returned: 0 in 0.262s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-648e7dfb-783a-487d-a046-c55cfe6def48" released by "delete_volume" :: held 0.769s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created reservations ['d522e351-d927-4b4a-a9f5-6d9027de525b', '8383b85d-c297-41d4-9a37-1fb5b78c8f6a', 'dc4554fb-a2dd-4a73-81e1-c56fc36f4e69', 'cd97ab5c-2443-449e-a6d2-35702eda3857'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:00 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730" returned: 0 in 0.394s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:00 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d 1G
Nov 06 08:39:00 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:00 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:00 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-e382d050-d69c-4530-8257-c110cf575fb6-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-e382d050-d69c-4530-8257-c110cf575fb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-e382d050-d69c-4530-8257-c110cf575fb6" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-e382d050-d69c-4530-8257-c110cf575fb6" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8afd0e2-2122-4e9b-a6ab-d8429cfc5bcb]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:00 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.363s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Deleted volume successfully.
Nov 06 08:39:00 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-f08b110a-40cc-4d74-8b3f-cd933d6e7c10 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-648e7dfb-783a-487d-a046-c55cfe6def48-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:01 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6
Nov 06 08:39:01 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:01 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d 1G" returned: 0 in 0.571s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77799279-2c5a-4260-84cc-0821c40a4730 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:01 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77799279-2c5a-4260-84cc-0821c40a4730 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d
Nov 06 08:39:01 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:01 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77799279-2c5a-4260-84cc-0821c40a4730 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d" returned: 0 in 0.381s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:01 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d is being set with open permissions: ugo+rw
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:01 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6" returned: 0 in 0.585s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:01 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d
Nov 06 08:39:01 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:01 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6
Nov 06 08:39:01 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Flow 'volume_create_manager' (2ce4ea2e-d384-4229-b9f7-94a0e85eb593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1097fdce-3552-410b-9196-4720fdc1d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1097fdce-3552-410b-9196-4720fdc1d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1199499119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8f97e2-586f-4b92-b610-1791eb95d26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3574a264ca4d1e927df6587148ed03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=981099d7-f2ad-4813-b3fc-1d0c8fdb51e0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:01Z,use_quota=True,user_id='d1429a36e11742b1987d7924573c4122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815e0932-4a1d-40d2-8a87-68f035c32758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815e0932-4a1d-40d2-8a87-68f035c32758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5ab59e-cfe1-4d22-8f85-30368257f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5ab59e-cfe1-4d22-8f85-30368257f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc8f97e2-586f-4b92-b610-1791eb95d26c', 'volume_name': 'volume-cc8f97e2-586f-4b92-b610-1791eb95d26c', 'volume_size': 1, 'snapshot_id': '981099d7-f2ad-4813-b3fc-1d0c8fdb51e0'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a73ff4-f727-4ec1-ab29-a709ccaaac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a73ff4-f727-4ec1-ab29-a709ccaaac0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f23228-264c-4c77-9af5-bf9d14ba50a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:01 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Volume cc8f97e2-586f-4b92-b610-1791eb95d26c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc8f97e2-586f-4b92-b610-1791eb95d26c', 'volume_size': 1, 'snapshot_id': '981099d7-f2ad-4813-b3fc-1d0c8fdb51e0'}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:01 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d" returned: 0 in 0.329s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:01 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e382d050-d69c-4530-8257-c110cf575fb6" returned: 0 in 0.316s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-e382d050-d69c-4530-8257-c110cf575fb6" released by "delete_volume" :: held 0.960s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:01 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.info
Nov 06 08:39:01 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created reservations ['4fe46015-842a-41fa-abf9-f9e5b8e55b85', '0a144ebd-0708-4cde-84a3-eb47b090c7bf', 'de31186b-c802-40f1-bb98-211ac34c21d2', '11d1acf1-be5f-4f66-a5ad-04d35269a586'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:02 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:02 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:02 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.info" returned: 0 in 0.321s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:02 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.info is being set with open permissions: ugo+rw
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:02 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.info
Nov 06 08:39:02 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:02 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.268s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Deleted volume successfully.
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-bfbac577-ab16-4354-965d-35a2ec5058be tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-e382d050-d69c-4530-8257-c110cf575fb6-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:02 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.info" returned: 0 in 0.277s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.730s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-quobyte-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0-cc8f97e2-586f-4b92-b610-1791eb95d26c" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0-cc8f97e2-586f-4b92-b610-1791eb95d26c" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Creating volume cc8f97e2-586f-4b92-b610-1791eb95d26c from snapshot 981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-quobyte-cc8f97e2-586f-4b92-b610-1791eb95d26c" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:02 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-53d60bd1-4888-4f11-9a69-02b9ce4bce3f tempest-ProjectReaderTests-1513806032 None] Create snapshot completed successfully
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-cc8f97e2-586f-4b92-b610-1791eb95d26c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] snapshot: 981099d7-f2ad-4813-b3fc-1d0c8fdb51e0, volume: cc8f97e2-586f-4b92-b610-1791eb95d26c,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa064a18-6343-4803-a47f-55fd5d648fe8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:02 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0
Nov 06 08:39:02 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-984f6354-a3b0-4636-ba2b-46951605213d-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Lock "cinder-984f6354-a3b0-4636-ba2b-46951605213d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-77799279-2c5a-4260-84cc-0821c40a4730" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-77799279-2c5a-4260-84cc-0821c40a4730" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-984f6354-a3b0-4636-ba2b-46951605213d" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-984f6354-a3b0-4636-ba2b-46951605213d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Deleting offline snapshot 984f6354-a3b0-4636-ba2b-46951605213d of volume 77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] snapshot_file for this snap is: volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a16dca-035b-4cb8-abf2-fd1ab240f3b4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:02 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d
Nov 06 08:39:02 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:03 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-ef6c4fd2-24ba-4a79-8429-e09ee63acee6-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" returned: 0 in 0.482s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79efd4be-cceb-4891-90f1-6f420cf5f580(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-ef6c4fd2-24ba-4a79-8429-e09ee63acee6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c85d7e-6883-4744-82b6-5581388c65ab]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-ef6c4fd2-24ba-4a79-8429-e09ee63acee6" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-ef6c4fd2-24ba-4a79-8429-e09ee63acee6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Deleting offline snapshot ef6c4fd2-24ba-4a79-8429-e09ee63acee6 of volume 4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] snapshot_file for this snap is: volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2632610e-1819-4f57-9562-a1fde77b6b4b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:03 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580
Nov 06 08:39:03 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:03 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:03 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6
Nov 06 08:39:03 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d" returned: 0 in 0.489s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77799279-2c5a-4260-84cc-0821c40a4730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7f52e3-3a34-4769-a28e-9eb1bad27826]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:03 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730
Nov 06 08:39:03 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:03 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580" returned: 0 in 0.520s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:03 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c
Nov 06 08:39:03 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:03 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6" returned: 0 in 0.470s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc53ef-137a-40c9-80b4-0fc428448301]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:03 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a
Nov 06 08:39:03 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:03 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730" returned: 0 in 0.487s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:03 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d
Nov 06 08:39:03 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:04 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" returned: 0 in 0.513s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:04 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6
Nov 06 08:39:04 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:04 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d" returned: 0 in 0.515s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:04 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d
Nov 06 08:39:04 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:05 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6" returned: 0 in 0.817s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:05 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730.984f6354-a3b0-4636-ba2b-46951605213d" returned: 0 in 0.682s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:05 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6
Nov 06 08:39:05 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-984f6354-a3b0-4636-ba2b-46951605213d" released by "_delete_snapshot" :: held 2.379s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-77799279-2c5a-4260-84cc-0821c40a4730" released by "delete_snapshot" :: held 2.422s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Created reservations ['11af586a-9e29-432b-9651-cce9faf04d77', '6c612a0d-1ed7-4d0f-858b-d7c221f4587e', 'eea1b1fb-60eb-4a8b-9561-0d6f80f80890', '3234fadc-167c-46b6-abd0-2d8d2f4b20cc'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Delete snapshot completed successfully.
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-810d1b46-3d27-459c-8dd6-d7bbaeeb9e1a tempest-ProjectReaderTests-1513806032 None] Lock "cinder-984f6354-a3b0-4636-ba2b-46951605213d-delete_snapshot" released by "delete_snapshot" :: held 2.685s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:05 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a.ef6c4fd2-24ba-4a79-8429-e09ee63acee6" returned: 0 in 0.496s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-ef6c4fd2-24ba-4a79-8429-e09ee63acee6" released by "_delete_snapshot" :: held 2.484s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" released by "delete_snapshot" :: held 2.525s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created reservations ['41c858c2-f335-42b5-b8e3-4253cea1f9c9', '6c060f2f-c894-474a-b309-c5af2a57d719', '4c8a5d22-f1d2-498e-88a1-ac2e93070f4c', 'fd18c731-4775-4029-9ae4-b04ee2623176'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Delete snapshot completed successfully.
Nov 06 08:39:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b5101460-3e7a-4281-8d89-97238afb61c2 tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-ef6c4fd2-24ba-4a79-8429-e09ee63acee6-delete_snapshot" released by "delete_snapshot" :: held 2.823s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-77799279-2c5a-4260-84cc-0821c40a4730-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-77799279-2c5a-4260-84cc-0821c40a4730-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-77799279-2c5a-4260-84cc-0821c40a4730" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-77799279-2c5a-4260-84cc-0821c40a4730" acquired by "delete_volume" :: waited 0.043s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[526efe33-00c2-40e8-b366-bb64d6df3477]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "cinder-quobyte-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" acquired by "delete_volume" :: waited 0.036s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a3c8a2-e4a7-4df5-8fc8-e364536067d6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:06 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730
Nov 06 08:39:06 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:07 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a
Nov 06 08:39:07 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:07 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730" returned: 0 in 0.722s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:07 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730
Nov 06 08:39:07 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:07 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" returned: 0 in 0.841s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:07 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a
Nov 06 08:39:07 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:07 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-77799279-2c5a-4260-84cc-0821c40a4730" returned: 0 in 0.540s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:07 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-77799279-2c5a-4260-84cc-0821c40a4730" released by "delete_volume" :: held 1.448s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Created reservations ['877f9af1-dede-4a55-9b59-ac46ea851cf3', '96b6ac59-c284-4b38-b396-8d291e1f7022', '6fba12ef-75ff-4da5-8db4-98e72da7ba79', 'ab970508-22f8-4a42-8388-cb4d123ef10b'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:08 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" returned: 0 in 0.671s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:08 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:08 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-quobyte-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a" released by "delete_volume" :: held 1.660s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Created reservations ['f054d02c-013f-4915-ac1e-7230b8dd6bb8', 'c9a3f7cc-4228-4970-a562-2a38c0d6a92c', '2c172159-e64b-4364-adee-d83ea559c5b8', '8392bdc5-a16e-4b80-9318-9d2418221c4f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:08 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:08 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:09 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.812s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Deleted volume successfully.
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1aac967d-4c73-4b39-b033-4b9b5803d1b4 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-77799279-2c5a-4260-84cc-0821c40a4730-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:09 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.874s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:09 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Deleted volume successfully.
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-adec7c0d-8d34-4a7c-9fd0-bb68f512c23b tempest-CreateVolumesFromSnapshotTest-1269813018 None] Lock "cinder-4d1f1f8b-74ff-40a0-8703-fe56971c1c6a-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (efff1301-de64-42f2-a7ed-47aa56372aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:09 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149fa538-69db-49e2-b6e0-9123649bdd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149fa538-69db-49e2-b6e0-9123649bdd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955367223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4141b6bf-a89a-4d89-a2b1-cb52d986d7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:10Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57796e50-cae0-4d35-8ce0-de1be89b7b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57796e50-cae0-4d35-8ce0-de1be89b7b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d88fb8-ccd5-42a6-a742-5e4c93d1367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d88fb8-ccd5-42a6-a742-5e4c93d1367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4141b6bf-a89a-4d89-a2b1-cb52d986d7ce', 'volume_name': 'volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e948d5c-d736-4399-9114-da51b354cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e948d5c-d736-4399-9114-da51b354cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e711d49-0859-46c1-8a07-a875d748a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:10 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Volume 4141b6bf-a89a-4d89-a2b1-cb52d986d7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce', 'volume_size': 1}
Nov 06 08:39:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:12 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c" returned: 0 in 9.267s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:12 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580, size 1024.00 MB, duration 9.27 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:39:12 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Converted 1024.00 MB image at 110.49 MB/s
Nov 06 08:39:12 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c is being set with open permissions: ugo+rw
Nov 06 08:39:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:12 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c
Nov 06 08:39:12 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:13 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-cc8f97e2-586f-4b92-b610-1791eb95d26c" released by "_copy_volume_from_snapshot" :: held 10.749s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=317,cinder:SELECT=217,cinder:INSERT=88,cinder:DELETE=31 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=249,cinder:UPDATE=322,cinder:DELETE=26,cinder:INSERT=83 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0-cc8f97e2-586f-4b92-b610-1791eb95d26c" released by "_create_volume_from_snapshot" :: held 10.856s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.885s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955367223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4141b6bf-a89a-4d89-a2b1-cb52d986d7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db644f11b3e34d8abd714ce9b6fa7a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:10Z,use_quota=True,user_id='c3d4434971624fcc8dc3d1608c09894d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Creating volume 4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:13 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f23228-264c-4c77-9af5-bf9d14ba50a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8f97e2-586f-4b92-b610-1791eb95d26c', 'volume_size': 1, 'snapshot_id': '981099d7-f2ad-4813-b3fc-1d0c8fdb51e0'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c947bf-095d-48b6-9f73-4d9d81c402ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:13 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce 1073741824
Nov 06 08:39:13 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:13 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Volume volume-cc8f97e2-586f-4b92-b610-1791eb95d26c (cc8f97e2-586f-4b92-b610-1791eb95d26c): created successfully
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c947bf-095d-48b6-9f73-4d9d81c402ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Flow 'volume_create_manager' (2ce4ea2e-d384-4229-b9f7-94a0e85eb593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:13 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a1b47550-d61e-4a25-8b9b-79a646f24d87 tempest-VolumeDependencyTests-697695769 None] Created volume successfully.
Nov 06 08:39:13 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce 1073741824" returned: 0 in 0.569s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:14 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce
Nov 06 08:39:14 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-quobyte-79efd4be-cceb-4891-90f1-6f420cf5f580" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-79efd4be-cceb-4891-90f1-6f420cf5f580" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-quobyte-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Deleting offline snapshot 981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 of volume 79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] snapshot_file for this snap is: volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaccf96b-f9fc-4d3e-bc1e-256ef1948641]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:14 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" returned: 0 in 0.398s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:14 devstack sudo[107507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0
Nov 06 08:39:14 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e711d49-0859-46c1-8a07-a875d748a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842ca70f-d634-4afb-a1c9-a9b867312240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Volume volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce (4141b6bf-a89a-4d89-a2b1-cb52d986d7ce): created successfully
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842ca70f-d634-4afb-a1c9-a9b867312240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Flow 'volume_create_manager' (efff1301-de64-42f2-a7ed-47aa56372aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:14 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-f205a592-3f77-4a66-bdc4-71b6e4857bd9 tempest-ProjectReaderTests-1513806032 None] Created volume successfully.
Nov 06 08:39:14 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" returned: 0 in 0.408s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79efd4be-cceb-4891-90f1-6f420cf5f580(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e5aad-145a-42fe-91b0-44e70dddc88c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:14 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580
Nov 06 08:39:14 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Flow 'volume_create_manager' (edbd9d00-50a9-4acc-bda5-88783dd29b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24d4f0-1d73-4a0b-a024-ed49bb9c0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24d4f0-1d73-4a0b-a024-ed49bb9c0db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c675e9-807e-40c3-9e42-69b3f710295d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ab437baeba48f88772e5a8758c7d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:15Z,use_quota=True,user_id='4821e4de07bf449c90980ef6865bbe3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09781f06-b51d-443c-aee7-cc95314d6c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09781f06-b51d-443c-aee7-cc95314d6c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b528c9-2384-4dc4-9c88-8937954f91df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b528c9-2384-4dc4-9c88-8937954f91df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c675e9-807e-40c3-9e42-69b3f710295d', 'volume_name': 'volume-39c675e9-807e-40c3-9e42-69b3f710295d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6458bc21-5464-44f6-bbd6-108f99758897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6458bc21-5464-44f6-bbd6-108f99758897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e679e5e-3970-4f33-af2e-6a0c9391aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Volume 39c675e9-807e-40c3-9e42-69b3f710295d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c675e9-807e-40c3-9e42-69b3f710295d', 'volume_size': 1}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c675e9-807e-40c3-9e42-69b3f710295d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ab437baeba48f88772e5a8758c7d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:15Z,use_quota=True,user_id='4821e4de07bf449c90980ef6865bbe3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Creating volume 39c675e9-807e-40c3-9e42-69b3f710295d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:15 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:15 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580" returned: 0 in 0.635s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:15 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d 1073741824
Nov 06 08:39:15 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:15 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0
Nov 06 08:39:15 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:15 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" returned: 0 in 0.440s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:15 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0
Nov 06 08:39:15 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:15 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d 1073741824" returned: 0 in 0.519s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:15 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d
Nov 06 08:39:15 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:16 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580.981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0" released by "_delete_snapshot" :: held 1.879s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-79efd4be-cceb-4891-90f1-6f420cf5f580" released by "delete_snapshot" :: held 1.920s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:16 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d" returned: 0 in 0.293s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.538s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e679e5e-3970-4f33-af2e-6a0c9391aba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c675e9-807e-40c3-9e42-69b3f710295d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f42edab-6a4a-439f-8359-c2a6fa515d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Creating offline snapshot 6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 of volume 4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:39:16 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Volume volume-39c675e9-807e-40c3-9e42-69b3f710295d (39c675e9-807e-40c3-9e42-69b3f710295d): created successfully
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f42edab-6a4a-439f-8359-c2a6fa515d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Flow 'volume_create_manager' (edbd9d00-50a9-4acc-bda5-88783dd29b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d64682-7967-49a5-8006-a1d12394fb7c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:16 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-d6c380c7-1c46-4a3a-9ea2-2bfbde1560ef tempest-CinderUnicodeTest-638700896 None] Created volume successfully.
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Created reservations ['203a3bd2-0369-4d65-aedd-65ef70c8ba07', 'd32f4bb3-20df-4086-a74e-781ed65b2824', '5329b861-8657-4b40-9064-756281e41a11', '293da2a6-c650-4926-bf40-90fe101dc606'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:16 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Delete snapshot completed successfully.
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-aece688c-764c-4dfe-b473-a0e121e6a1c1 tempest-VolumeDependencyTests-697695769 None] Lock "cinder-981099d7-f2ad-4813-b3fc-1d0c8fdb51e0-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:16 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce
Nov 06 08:39:16 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:16 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" returned: 0 in 0.418s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:16 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 1G
Nov 06 08:39:16 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:17 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 1G" returned: 0 in 0.530s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:17 devstack sudo[107584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1
Nov 06 08:39:17 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-79efd4be-cceb-4891-90f1-6f420cf5f580-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Lock "cinder-79efd4be-cceb-4891-90f1-6f420cf5f580-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-quobyte-79efd4be-cceb-4891-90f1-6f420cf5f580" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-79efd4be-cceb-4891-90f1-6f420cf5f580" acquired by "delete_volume" :: waited 0.025s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d228f63d-7fe8-4aff-900b-09007165e5f1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:17 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580
Nov 06 08:39:17 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:17 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" returned: 0 in 0.503s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:17 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 is being set with open permissions: ugo+rw
Nov 06 08:39:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:17 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1
Nov 06 08:39:17 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:18 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Flow 'volume_create_manager' (17121033-2501-4ed6-881f-af12f5985e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc48a02a-5f4a-4425-9404-eb00e0f8388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" returned: 0 in 0.344s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:18 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc48a02a-5f4a-4425-9404-eb00e0f8388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-332215405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffd8d87-6297-4cc0-ab7a-f203583fb2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ab437baeba48f88772e5a8758c7d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:18Z,use_quota=True,user_id='4821e4de07bf449c90980ef6865bbe3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d28922-6d58-418f-98ef-775063f2791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d28922-6d58-418f-98ef-775063f2791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96bef8e-0986-4657-bda2-ace78a3511c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96bef8e-0986-4657-bda2-ace78a3511c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffd8d87-6297-4cc0-ab7a-f203583fb2fc', 'volume_name': 'volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81162b58-ede7-49c2-9231-0e06351f10ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81162b58-ede7-49c2-9231-0e06351f10ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2021b871-24b8-49ab-baf1-ea059163a9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:18 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Volume cffd8d87-6297-4cc0-ab7a-f203583fb2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc', 'volume_size': 1}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580" returned: 0 in 0.584s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:18 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:18 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:18 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.info
Nov 06 08:39:18 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:18 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79efd4be-cceb-4891-90f1-6f420cf5f580" returned: 0 in 0.297s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:18 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.info" returned: 0 in 0.296s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:18 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.info is being set with open permissions: ugo+rw
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-79efd4be-cceb-4891-90f1-6f420cf5f580" released by "delete_volume" :: held 0.987s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:18 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.info
Nov 06 08:39:18 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Created reservations ['92e0e52a-5e57-4e2b-958d-596173703cd6', 'e44538c5-6f85-40a6-b521-cce577ea2ff2', '39d016d0-c9f3-448a-ae46-60e96de6c506', 'a87b5c51-2b13-4874-bef1-85f0ba6d2b1a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:18 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:18 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:18 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.info" returned: 0 in 0.276s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-332215405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffd8d87-6297-4cc0-ab7a-f203583fb2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ab437baeba48f88772e5a8758c7d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:18Z,use_quota=True,user_id='4821e4de07bf449c90980ef6865bbe3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Creating volume cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:18 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:18 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc 1073741824
Nov 06 08:39:18 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:18 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-39fce9de-c667-45b6-8c61-da4149897148 tempest-ProjectReaderTests-1513806032 None] Create snapshot completed successfully
Nov 06 08:39:18 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.328s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:18 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Deleted volume successfully.
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-327890d0-d62e-41ae-b414-28b614f123be tempest-VolumeDependencyTests-697695769 None] Lock "cinder-79efd4be-cceb-4891-90f1-6f420cf5f580-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:19 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc 1073741824" returned: 0 in 0.502s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:19 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc
Nov 06 08:39:19 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:19 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2021b871-24b8-49ab-baf1-ea059163a9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e438b65-dd3c-4047-810f-30081d8c60de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:19 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Volume volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc (cffd8d87-6297-4cc0-ab7a-f203583fb2fc): created successfully
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e438b65-dd3c-4047-810f-30081d8c60de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Flow 'volume_create_manager' (17121033-2501-4ed6-881f-af12f5985e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6ecd97ab-8a90-4f84-bb47-34bf11e74e0c tempest-CinderUnicodeTest-638700896 None] Created volume successfully.
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-cc8f97e2-586f-4b92-b610-1791eb95d26c-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Lock "cinder-cc8f97e2-586f-4b92-b610-1791eb95d26c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Acquiring lock "cinder-quobyte-cc8f97e2-586f-4b92-b610-1791eb95d26c" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-cc8f97e2-586f-4b92-b610-1791eb95d26c" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c4ec6-e953-414c-abfb-dd064a18b64c]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:19 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Deleting offline snapshot 6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 of volume 4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] snapshot_file for this snap is: volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:20 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c
Nov 06 08:39:20 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4956d5a3-355a-409c-ab30-e6d9dbce96e9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:20 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1
Nov 06 08:39:20 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:20 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c" returned: 0 in 0.535s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:20 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c
Nov 06 08:39:20 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Creating offline snapshot a8075f0b-a888-4375-9165-c56cf16a6485 of volume cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:39:20 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3005e0-fa7d-4e1a-ac0b-2ecf18711ccd]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" returned: 0 in 0.541s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f5a139-f5fe-4a07-8b79-f8cbc0a3d106]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:20 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:20 devstack sudo[107631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc
Nov 06 08:39:20 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cc8f97e2-586f-4b92-b610-1791eb95d26c" returned: 0 in 0.304s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Lock "cinder-quobyte-cc8f97e2-586f-4b92-b610-1791eb95d26c" released by "delete_volume" :: held 0.903s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:20 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce
Nov 06 08:39:20 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Created reservations ['28308dd2-e943-4cfb-9676-56fef7c893e2', 'c219b358-b302-4c20-b5ce-8b59a57a2a4d', '916fd110-c45f-40bb-8b81-0cbca17bbc81', 'cd7819df-5e99-413d-b213-51cf0ac7aa60'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:20 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:20 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:21 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" returned: 0 in 0.495s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:21 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 1G
Nov 06 08:39:21 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:21 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" returned: 0 in 0.506s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:21 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1
Nov 06 08:39:21 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:21 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.367s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:21 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Deleted volume successfully.
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2c86ab7f-7099-41c6-a0ad-cd68723bf22b tempest-VolumeDependencyTests-697695769 None] Lock "cinder-cc8f97e2-586f-4b92-b610-1791eb95d26c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:21 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" returned: 0 in 0.446s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:21 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1
Nov 06 08:39:21 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:21 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 1G" returned: 0 in 0.726s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:21 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485
Nov 06 08:39:21 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:21 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce.6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" returned: 0 in 0.302s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1" released by "_delete_snapshot" :: held 1.956s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:21 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" released by "delete_snapshot" :: held 1.989s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Created reservations ['e9689d6a-04d4-4d8c-ba41-6fa846155b4d', '77ab247a-21e1-43f6-a108-c883f9548907', '9e929420-a513-48c3-ba74-af6f8cdf1d5a', 'dc3e13f2-07fa-42c4-b222-1fbb09e861e9'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Delete snapshot completed successfully.
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2aee2008-2f6e-42f7-b228-a888cc2c1f47 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-6dd4c4c7-32c3-44f0-8d38-5aac5acdfcd1-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:22 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485" returned: 0 in 0.431s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:22 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 is being set with open permissions: ugo+rw
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:22 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485
Nov 06 08:39:22 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:22 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485" returned: 0 in 0.275s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:22 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.info
Nov 06 08:39:22 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:22 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.info" returned: 0 in 0.286s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:22 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.info is being set with open permissions: ugo+rw
Nov 06 08:39:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:22 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.info
Nov 06 08:39:22 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:23 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.info" returned: 0 in 0.275s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:23 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-35984322-ff08-47ce-83ac-4086dc363e71 tempest-CinderUnicodeTest-638700896 None] Create snapshot completed successfully
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "cinder-quobyte-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f5b88-0c96-401a-a8e5-3ce0eb36dcc2]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:23 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce
Nov 06 08:39:23 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Acquiring lock "cinder-a8075f0b-a888-4375-9165-c56cf16a6485-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Lock "cinder-a8075f0b-a888-4375-9165-c56cf16a6485-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Acquiring lock "cinder-quobyte-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Acquiring lock "cinder-quobyte-a8075f0b-a888-4375-9165-c56cf16a6485" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-a8075f0b-a888-4375-9165-c56cf16a6485" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Deleting offline snapshot a8075f0b-a888-4375-9165-c56cf16a6485 of volume cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] snapshot_file for this snap is: volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cee53b-5373-4bc2-946d-2476f9b3dd9f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:24 devstack sudo[107676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485
Nov 06 08:39:24 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:24 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" returned: 0 in 0.550s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:24 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce
Nov 06 08:39:24 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:24 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485" returned: 0 in 0.473s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[22349bed-62a4-4604-85fa-2e07906d5029]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:24 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" returned: 0 in 0.342s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-quobyte-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce" released by "delete_volume" :: held 0.997s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Created reservations ['2c2e03ce-12ae-4b9a-be3b-23f0be6c4e68', '9ab1ecbd-fc73-4afb-83c5-a6893a4562af', 'c2ea38f0-7d01-46a8-bc0c-bbea8cac6805', '998325db-054d-4e87-ba14-a5045e60bc1a'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:24 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc
Nov 06 08:39:24 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:24 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:24 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:24 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" returned: 0 in 0.500s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:24 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:24 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.321s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:24 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:24 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:24 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Deleted volume successfully.
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-5e5914d9-8077-456d-9ed7-816ca04a7321 tempest-ProjectReaderTests-1513806032 None] Lock "cinder-4141b6bf-a89a-4d89-a2b1-cb52d986d7ce-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:25 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485" returned: 0 in 0.423s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:25 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485
Nov 06 08:39:25 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:25 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc.a8075f0b-a888-4375-9165-c56cf16a6485" returned: 0 in 0.307s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-a8075f0b-a888-4375-9165-c56cf16a6485" released by "_delete_snapshot" :: held 1.882s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" released by "delete_snapshot" :: held 1.921s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Created reservations ['4ce33f0c-eb82-4b49-91f2-d8be31ca78cd', 'cc6de61a-ad24-41d0-b8cb-b96a665278aa', '876ab954-a1c2-4750-9b5e-f88dde6b462d', '16a22519-ace8-4457-ac2d-8705542ea0aa'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:25 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Delete snapshot completed successfully.
Nov 06 08:39:25 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e48c12e7-6d0b-4568-ae76-7a12f7a72ebf tempest-CinderUnicodeTest-638700896 None] Lock "cinder-a8075f0b-a888-4375-9165-c56cf16a6485-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Acquiring lock "cinder-cffd8d87-6297-4cc0-ab7a-f203583fb2fc-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Lock "cinder-cffd8d87-6297-4cc0-ab7a-f203583fb2fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Acquiring lock "cinder-quobyte-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" acquired by "delete_volume" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f8b1b-403e-4af3-96db-293abbd49150]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:26 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc
Nov 06 08:39:26 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:26 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" returned: 0 in 0.560s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:26 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc
Nov 06 08:39:26 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:27 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-cffd8d87-6297-4cc0-ab7a-f203583fb2fc" released by "delete_volume" :: held 1.074s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Created reservations ['c16d76cd-0113-472d-867f-7759abebe289', '428d5e42-d110-4b5a-8ee3-4a197a7cdd58', 'c44aa503-ccbc-4926-ad97-bdd08d917ac1', '8446557f-37eb-48a1-871b-197d9da48e25'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:27 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:27 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:27 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.324s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Deleted volume successfully.
Nov 06 08:39:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-8506dc2f-23e7-483f-89ac-1cfe5eeb4705 tempest-CinderUnicodeTest-638700896 None] Lock "cinder-cffd8d87-6297-4cc0-ab7a-f203583fb2fc-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Acquiring lock "cinder-39c675e9-807e-40c3-9e42-69b3f710295d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Lock "cinder-39c675e9-807e-40c3-9e42-69b3f710295d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Acquiring lock "cinder-quobyte-39c675e9-807e-40c3-9e42-69b3f710295d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-39c675e9-807e-40c3-9e42-69b3f710295d" acquired by "delete_volume" :: waited 0.027s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:28 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[759818f2-ae6b-4c0a-a348-07a5d4e9ea42]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:28 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d
Nov 06 08:39:28 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:29 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d" returned: 0 in 0.506s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:29 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d
Nov 06 08:39:29 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:29 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-39c675e9-807e-40c3-9e42-69b3f710295d" returned: 0 in 0.334s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Lock "cinder-quobyte-39c675e9-807e-40c3-9e42-69b3f710295d" released by "delete_volume" :: held 0.915s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Created reservations ['d64280f5-497c-4c19-baa8-83f74225ec7c', 'a9c1f157-2982-4b63-9e40-f342772669c4', 'fb937b2f-20db-4fc6-85c3-0be04bc800d7', 'e0538917-f470-459c-b232-466d96ef575b'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:29 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:29 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:29 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.293s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Deleted volume successfully.
Nov 06 08:39:29 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4f59bdae-c2d2-456f-8477-23c1618dce5c tempest-CinderUnicodeTest-638700896 None] Lock "cinder-39c675e9-807e-40c3-9e42-69b3f710295d-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:30 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:30 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:30 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:39:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (ce40c110-b4e5-4e76-990a-e4e7f45c1ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb3d47-8917-4698-a1b8-f2882f6a8a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb3d47-8917-4698-a1b8-f2882f6a8a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565772354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5e6edf-a22b-49c9-b78a-7e75951c56af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:31Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f455291-7e94-4c59-8e91-87db1cb417fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f455291-7e94-4c59-8e91-87db1cb417fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc29b379-bef8-4191-92fb-e727f27975a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc29b379-bef8-4191-92fb-e727f27975a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5e6edf-a22b-49c9-b78a-7e75951c56af', 'volume_name': 'volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a8106-7664-4469-810b-c9a6ba34ac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a8106-7664-4469-810b-c9a6ba34ac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b5b1fd-1f53-4324-b2ab-33973c7e424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:31 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Volume eb5e6edf-a22b-49c9-b78a-7e75951c56af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af', 'volume_size': 1}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565772354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5e6edf-a22b-49c9-b78a-7e75951c56af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:31Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Creating volume eb5e6edf-a22b-49c9-b78a-7e75951c56af {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:31 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:31 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af 1073741824
Nov 06 08:39:31 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Flow 'volume_create_manager' (70ebad98-00aa-4d11-a5a7-209c2e3e6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8179b6db-85a0-4042-8484-5c749c7f2ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8179b6db-85a0-4042-8484-5c749c7f2ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1164459853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8764665f-9452-4cb4-a1d6-4c06322d7886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64c663f113c4f7691974c4aa84e52ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:32Z,use_quota=True,user_id='7586f6be661847b99ff555ddd53346ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5d9133-fc95-48d8-8201-11d5b53b6a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5d9133-fc95-48d8-8201-11d5b53b6a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88cc17d-e777-4181-9e40-ea0d6849a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88cc17d-e777-4181-9e40-ea0d6849a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8764665f-9452-4cb4-a1d6-4c06322d7886', 'volume_name': 'volume-8764665f-9452-4cb4-a1d6-4c06322d7886', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735ffad6-a67b-4933-95eb-5b46a5024079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735ffad6-a67b-4933-95eb-5b46a5024079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfc609c-ebc8-49aa-a6b8-d9e466f0c51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Volume 8764665f-9452-4cb4-a1d6-4c06322d7886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8764665f-9452-4cb4-a1d6-4c06322d7886', 'volume_size': 1}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af 1073741824" returned: 0 in 0.688s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:32 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af
Nov 06 08:39:32 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:32 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af" returned: 0 in 0.280s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1164459853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8764665f-9452-4cb4-a1d6-4c06322d7886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64c663f113c4f7691974c4aa84e52ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:32Z,use_quota=True,user_id='7586f6be661847b99ff555ddd53346ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Creating volume 8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:32 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:32 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 1073741824
Nov 06 08:39:32 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b5b1fd-1f53-4324-b2ab-33973c7e424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263404de-ac74-4c23-9ee7-78095b50f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Volume volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af (eb5e6edf-a22b-49c9-b78a-7e75951c56af): created successfully
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263404de-ac74-4c23-9ee7-78095b50f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (ce40c110-b4e5-4e76-990a-e4e7f45c1ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:32 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-7ba472a7-d980-4161-b1f1-455ac97f068c tempest-ProjectReaderTests-958435670 None] Created volume successfully.
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (aa522d8e-3d2a-4efb-aea6-6e5260160e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d04464-77a3-4780-ab52-0deeb2c0f4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d04464-77a3-4780-ab52-0deeb2c0f4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766014608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6aa0bb6-98d4-4f75-b913-a363da8dd76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:33Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305c6e0-aa92-4463-8dc1-7de8872a49a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305c6e0-aa92-4463-8dc1-7de8872a49a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28070900-3f53-475a-b943-992287ed2580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28070900-3f53-475a-b943-992287ed2580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6aa0bb6-98d4-4f75-b913-a363da8dd76d', 'volume_name': 'volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb542df-c6e6-4b8b-95c3-bb990f881248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb542df-c6e6-4b8b-95c3-bb990f881248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b54d381-be39-43ce-a4d7-c1bbda144458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:32 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Volume f6aa0bb6-98d4-4f75-b913-a363da8dd76d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d', 'volume_size': 1}
Nov 06 08:39:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:33 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 1073741824" returned: 0 in 0.490s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:33 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886
Nov 06 08:39:33 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:33 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886" returned: 0 in 0.265s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766014608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6aa0bb6-98d4-4f75-b913-a363da8dd76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:33Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Creating volume f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:33 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:33 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d 1073741824
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfc609c-ebc8-49aa-a6b8-d9e466f0c51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8764665f-9452-4cb4-a1d6-4c06322d7886', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:33 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d74b019-ca01-47e8-af57-b56facd930fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:33 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Volume volume-8764665f-9452-4cb4-a1d6-4c06322d7886 (8764665f-9452-4cb4-a1d6-4c06322d7886): created successfully
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d74b019-ca01-47e8-af57-b56facd930fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Flow 'volume_create_manager' (70ebad98-00aa-4d11-a5a7-209c2e3e6f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-620b282f-be15-4e0f-8d6b-d0fbd5663512 tempest-SnapshotDependencyTests-721993827 None] Created volume successfully.
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-eb5e6edf-a22b-49c9-b78a-7e75951c56af-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Lock "cinder-eb5e6edf-a22b-49c9-b78a-7e75951c56af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-quobyte-eb5e6edf-a22b-49c9-b78a-7e75951c56af" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-eb5e6edf-a22b-49c9-b78a-7e75951c56af" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[97890821-3650-42ed-9e72-21b22ed88140]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:33 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d 1073741824" returned: 0 in 0.571s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:34 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af
Nov 06 08:39:34 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:34 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d
Nov 06 08:39:34 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:34 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" returned: 0 in 0.302s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b54d381-be39-43ce-a4d7-c1bbda144458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5059eeb-cc86-4a84-924c-bef66bd164ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:34 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Volume volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d (f6aa0bb6-98d4-4f75-b913-a363da8dd76d): created successfully
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5059eeb-cc86-4a84-924c-bef66bd164ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:34 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (aa522d8e-3d2a-4efb-aea6-6e5260160e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af" returned: 0 in 0.491s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9d12a216-fb27-448c-9cb9-2301ba83b363 tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:39:34 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af
Nov 06 08:39:34 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Creating offline snapshot da05d167-89d3-47ce-9ba7-b33a9ff545f4 of volume 8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d250b-2460-4f11-a7d2-1104d1a6c061]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:34 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886
Nov 06 08:39:34 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:34 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-eb5e6edf-a22b-49c9-b78a-7e75951c56af" returned: 0 in 0.294s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-eb5e6edf-a22b-49c9-b78a-7e75951c56af" released by "delete_volume" :: held 0.837s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Created reservations ['982aa7a2-e56a-40ba-8339-58567e504d15', '557c0189-0df5-4ece-a913-d50a9fc343d9', '1d8d9cb7-adfa-4a13-bb22-c7b170e060c8', '25512a94-3279-4c3f-af2d-e5549f72a6f8'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:34 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:34 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:35 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886" returned: 0 in 0.438s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:35 devstack sudo[107772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 1G
Nov 06 08:39:35 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:35 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.386s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:35 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Deleted volume successfully.
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-85e4e547-a78a-4b92-a2df-5e4fcf21e1e0 tempest-ProjectReaderTests-958435670 None] Lock "cinder-eb5e6edf-a22b-49c9-b78a-7e75951c56af-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:35 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 1G" returned: 0 in 0.624s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8764665f-9452-4cb4-a1d6-4c06322d7886 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:35 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8764665f-9452-4cb4-a1d6-4c06322d7886 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4
Nov 06 08:39:35 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (7fbc047e-7bb8-4945-9d7d-e55c6904fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da802528-f8d0-4507-9b45-31301580c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da802528-f8d0-4507-9b45-31301580c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921262065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f6fcc7-e135-4beb-b575-acf0e060402d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:36Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0b4e14-3b7e-4ae7-b2c3-2ae6beb7e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0b4e14-3b7e-4ae7-b2c3-2ae6beb7e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277f7ba2-fc56-4f53-9399-17833e78d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277f7ba2-fc56-4f53-9399-17833e78d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f6fcc7-e135-4beb-b575-acf0e060402d', 'volume_name': 'volume-79f6fcc7-e135-4beb-b575-acf0e060402d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ef7823-efbd-4167-87d7-1cb95caf6709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ef7823-efbd-4167-87d7-1cb95caf6709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879ae984-85bc-4581-8c41-594ec1757778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Volume 79f6fcc7-e135-4beb-b575-acf0e060402d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f6fcc7-e135-4beb-b575-acf0e060402d', 'volume_size': 1}
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:35 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8764665f-9452-4cb4-a1d6-4c06322d7886 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4" returned: 0 in 0.311s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:35 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 is being set with open permissions: ugo+rw
Nov 06 08:39:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:35 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4
Nov 06 08:39:35 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:36 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4" returned: 0 in 0.266s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:36 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.info
Nov 06 08:39:36 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:36 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.info" returned: 0 in 0.271s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:36 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.info is being set with open permissions: ugo+rw
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:36 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.info
Nov 06 08:39:36 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:36 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.info" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.121s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Creating offline snapshot c04cb324-b490-4ede-af83-75c4c738956b of volume f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:39:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-8485ae58-656e-4b16-9a28-48dfe6020608 tempest-SnapshotDependencyTests-721993827 None] Create snapshot completed successfully
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[467a72f9-87cf-4bf5-beab-4f6dbd49eac0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:36 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d
Nov 06 08:39:36 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:37 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" returned: 0 in 0.371s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:37 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b 1G
Nov 06 08:39:37 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:37 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b 1G" returned: 0 in 0.444s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:37 devstack sudo[107805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b
Nov 06 08:39:37 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:37 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b" returned: 0 in 0.323s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:37 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b is being set with open permissions: ugo+rw
Nov 06 08:39:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:38 devstack sudo[107811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b
Nov 06 08:39:38 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:38 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b" returned: 0 in 0.296s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:38 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.info
Nov 06 08:39:38 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Flow 'volume_create_manager' (40a86046-cb02-4bae-a2ca-db200bc87110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:38 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15029d9-d54d-4500-8015-f9a4e52d2540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.info" returned: 0 in 0.285s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:38 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.info is being set with open permissions: ugo+rw
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15029d9-d54d-4500-8015-f9a4e52d2540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35ec026-dadb-4f2f-8399-72c9bf1bd399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64c663f113c4f7691974c4aa84e52ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da05d167-89d3-47ce-9ba7-b33a9ff545f4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:38Z,use_quota=True,user_id='7586f6be661847b99ff555ddd53346ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:38 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.info
Nov 06 08:39:38 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68bbc27-a258-4d9c-aca5-90b49b4d5d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68bbc27-a258-4d9c-aca5-90b49b4d5d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d48961-b0e3-4c1d-9dea-746f8ec1aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d48961-b0e3-4c1d-9dea-746f8ec1aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd35ec026-dadb-4f2f-8399-72c9bf1bd399', 'volume_name': 'volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399', 'volume_size': 1, 'snapshot_id': 'da05d167-89d3-47ce-9ba7-b33a9ff545f4'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbfe018-7793-420e-8997-12627f8107a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbfe018-7793-420e-8997-12627f8107a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133db466-d45d-4560-af53-12a235f8cee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:38 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Volume d35ec026-dadb-4f2f-8399-72c9bf1bd399: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399', 'volume_size': 1, 'snapshot_id': 'da05d167-89d3-47ce-9ba7-b33a9ff545f4'}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:38 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.info" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.059s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921262065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f6fcc7-e135-4beb-b575-acf0e060402d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:36Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Creating volume 79f6fcc7-e135-4beb-b575-acf0e060402d {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:38 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:38 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d 1073741824
Nov 06 08:39:38 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6356fe08-be0d-4928-bc46-56b6431a83f0 tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:39:39 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d 1073741824" returned: 0 in 0.435s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:39 devstack sudo[107826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d
Nov 06 08:39:39 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:39 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d" returned: 0 in 0.283s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.960s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-quobyte-da05d167-89d3-47ce-9ba7-b33a9ff545f4-d35ec026-dadb-4f2f-8399-72c9bf1bd399" by "_create_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879ae984-85bc-4581-8c41-594ec1757778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f6fcc7-e135-4beb-b575-acf0e060402d', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0006c1-e7a9-453f-80f8-8d88fa5f13ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-da05d167-89d3-47ce-9ba7-b33a9ff545f4-d35ec026-dadb-4f2f-8399-72c9bf1bd399" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Creating volume d35ec026-dadb-4f2f-8399-72c9bf1bd399 from snapshot da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-quobyte-d35ec026-dadb-4f2f-8399-72c9bf1bd399" by "_copy_volume_from_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-c04cb324-b490-4ede-af83-75c4c738956b-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:39 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Volume volume-79f6fcc7-e135-4beb-b575-acf0e060402d (79f6fcc7-e135-4beb-b575-acf0e060402d): created successfully
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0006c1-e7a9-453f-80f8-8d88fa5f13ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (7fbc047e-7bb8-4945-9d7d-e55c6904fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-d35ec026-dadb-4f2f-8399-72c9bf1bd399" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] snapshot: da05d167-89d3-47ce-9ba7-b33a9ff545f4, volume: d35ec026-dadb-4f2f-8399-72c9bf1bd399,  {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Lock "cinder-c04cb324-b490-4ede-af83-75c4c738956b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:39 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-bbed8125-fd1a-433e-b443-821f1ea301fd tempest-ProjectReaderTests-958435670 None] Created volume successfully.
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-c04cb324-b490-4ede-af83-75c4c738956b" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5621f0-f5d0-4c2f-a7fb-dda3a0dcfd9f]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-c04cb324-b490-4ede-af83-75c4c738956b" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot c04cb324-b490-4ede-af83-75c4c738956b of volume f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d59e70-8ecf-41ac-84b6-5101bf34be8a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-79f6fcc7-e135-4beb-b575-acf0e060402d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:39 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4
Nov 06 08:39:39 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:39 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Lock "cinder-79f6fcc7-e135-4beb-b575-acf0e060402d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-quobyte-79f6fcc7-e135-4beb-b575-acf0e060402d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-79f6fcc7-e135-4beb-b575-acf0e060402d" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:40 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b
Nov 06 08:39:40 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6ff93b-1847-47e7-8b95-0d743c790c4a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:40 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d
Nov 06 08:39:40 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:40 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4" returned: 0 in 0.454s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8764665f-9452-4cb4-a1d6-4c06322d7886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f560dcc-a6d2-4426-a787-aab2f5fba342]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:40 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b" returned: 0 in 0.476s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c34afd-5904-4bec-a5de-62240da1b325]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:40 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886
Nov 06 08:39:40 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:40 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d" returned: 0 in 0.456s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:40 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d
Nov 06 08:39:40 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:40 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d
Nov 06 08:39:40 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:40 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886" returned: 0 in 0.474s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Creating direct copy from snapshot {{(pid=87143) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.utils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Path /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 not found in is_blk_device check {{(pid=87143) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:40 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399
Nov 06 08:39:40 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:40 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-79f6fcc7-e135-4beb-b575-acf0e060402d" returned: 0 in 0.297s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-79f6fcc7-e135-4beb-b575-acf0e060402d" released by "delete_volume" :: held 0.816s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:40 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" returned: 0 in 0.480s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:40 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Created reservations ['ab6a102b-8415-4782-8903-07c6d52be76c', 'd2866a32-793a-4d2d-82c3-7ab990457b05', '8a2dbb48-e7d1-4aca-bc9b-36b7ffc31d44', 'f0683af9-e643-44ca-9570-f6d2963340da'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:40 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b
Nov 06 08:39:40 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:41 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:41 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:41 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.424s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:41 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Deleted volume successfully.
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1e1ea024-c24e-43a8-ae09-c6a0edde0479 tempest-ProjectReaderTests-958435670 None] Lock "cinder-79f6fcc7-e135-4beb-b575-acf0e060402d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:41 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b" returned: 0 in 0.747s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:41 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b
Nov 06 08:39:41 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:42 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d.c04cb324-b490-4ede-af83-75c4c738956b" returned: 0 in 0.434s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-c04cb324-b490-4ede-af83-75c4c738956b" released by "_delete_snapshot" :: held 2.344s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (7e213062-0074-4172-a73c-afac75cdd00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e464b2-523c-45c3-a605-c136d7a4e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" released by "delete_snapshot" :: held 2.442s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e464b2-523c-45c3-a605-c136d7a4e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683169011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c645497-2722-46eb-ac98-c25c4412cf51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:42Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98595bba-1362-4abf-9e62-d1d4770c6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98595bba-1362-4abf-9e62-d1d4770c6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61321cbb-caa2-4fe5-b97a-025d0c7d7a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61321cbb-caa2-4fe5-b97a-025d0c7d7a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c645497-2722-46eb-ac98-c25c4412cf51', 'volume_name': 'volume-5c645497-2722-46eb-ac98-c25c4412cf51', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4e8d59-04d1-435f-9349-5a227c1c4bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4e8d59-04d1-435f-9349-5a227c1c4bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668e5d29-65a1-43d4-b9a5-fe421b046218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:42 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Volume 5c645497-2722-46eb-ac98-c25c4412cf51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c645497-2722-46eb-ac98-c25c4412cf51', 'volume_size': 1}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Created reservations ['70300006-8e3c-474f-8baf-fda19bf43f6f', '6b6dac18-b9af-4ab0-b40a-d23a4f8f0d46', 'a9a044eb-bb6b-40a9-8cfe-78b545856987', '911af12d-3c22-463e-aa53-8e89bb9dd976'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:39:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1f7eed6-498c-4f48-b0ba-059bbdf8658d tempest-ProjectMemberTests-493719806 None] Lock "cinder-c04cb324-b490-4ede-af83-75c4c738956b-delete_snapshot" released by "delete_snapshot" :: held 2.788s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-f6aa0bb6-98d4-4f75-b913-a363da8dd76d-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Lock "cinder-f6aa0bb6-98d4-4f75-b913-a363da8dd76d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:43 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" acquired by "delete_volume" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe20c20-1bb6-4c3e-bfe4-0825fb2f36e4]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:43 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d
Nov 06 08:39:43 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:43 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" returned: 0 in 0.688s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:44 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d
Nov 06 08:39:44 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:44 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" returned: 0 in 0.528s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-f6aa0bb6-98d4-4f75-b913-a363da8dd76d" released by "delete_volume" :: held 1.368s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Created reservations ['66bf5831-1238-4e79-9111-f72ac031cee5', '167bb3fe-0189-4a67-b9c6-f154d07cc8e0', '2d185644-deed-403c-9f2a-15757f081365', '78a5f858-0a2c-4b63-93fc-de258d440908'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:44 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:44 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:45 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.462s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:45 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:39:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-25ad46f3-4bc7-495b-8744-225eef37d198 tempest-ProjectMemberTests-493719806 None] Lock "cinder-f6aa0bb6-98d4-4f75-b913-a363da8dd76d-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (0e42d71d-db77-4fcd-8d38-cdf4909c94ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4152c4-801f-44c8-a8e1-4615af437250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4152c4-801f-44c8-a8e1-4615af437250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41735258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:46Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b7797a-36c1-413f-b0dd-71ae4c0061d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b7797a-36c1-413f-b0dd-71ae4c0061d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc480b6-d8e1-49f5-be4b-d43b4395a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc480b6-d8e1-49f5-be4b-d43b4395a02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354', 'volume_name': 'volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdd4f03-e1b3-4815-9fc1-e95263d0c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdd4f03-e1b3-4815-9fc1-e95263d0c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4510a9-3344-4090-b00e-2c9b8242fd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:46 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Volume 1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354', 'volume_size': 1}
Nov 06 08:39:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:48 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399" returned: 0 in 8.096s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:48 devstack cinder-volume[87143]: DEBUG cinder.image.image_utils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Image conversion details: src /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 {{(pid=87143) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 08:39:48 devstack cinder-volume[87143]: INFO cinder.image.image_utils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Converted 1024.00 MB image at 126.47 MB/s
Nov 06 08:39:48 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 is being set with open permissions: ugo+rw
Nov 06 08:39:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:48 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399
Nov 06 08:39:48 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:49 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-d35ec026-dadb-4f2f-8399-72c9bf1bd399" released by "_copy_volume_from_snapshot" :: held 9.403s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-da05d167-89d3-47ce-9ba7-b33a9ff545f4-d35ec026-dadb-4f2f-8399-72c9bf1bd399" released by "_create_volume_from_snapshot" :: held 9.500s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.540s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.829s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683169011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c645497-2722-46eb-ac98-c25c4412cf51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:42Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Creating volume 5c645497-2722-46eb-ac98-c25c4412cf51 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:49 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:49 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51 1073741824
Nov 06 08:39:49 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133db466-d45d-4560-af53-12a235f8cee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399', 'volume_size': 1, 'snapshot_id': 'da05d167-89d3-47ce-9ba7-b33a9ff545f4'}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4f0e43-e6ed-4d19-85a5-756b71860347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:49 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Volume volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 (d35ec026-dadb-4f2f-8399-72c9bf1bd399): created successfully
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4f0e43-e6ed-4d19-85a5-756b71860347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Flow 'volume_create_manager' (40a86046-cb02-4bae-a2ca-db200bc87110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6dab5c47-bb13-4c25-ac9a-55f1f37de777 tempest-SnapshotDependencyTests-721993827 None] Created volume successfully.
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-da05d167-89d3-47ce-9ba7-b33a9ff545f4-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-da05d167-89d3-47ce-9ba7-b33a9ff545f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-quobyte-8764665f-9452-4cb4-a1d6-4c06322d7886" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-8764665f-9452-4cb4-a1d6-4c06322d7886" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-quobyte-da05d167-89d3-47ce-9ba7-b33a9ff545f4" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-da05d167-89d3-47ce-9ba7-b33a9ff545f4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Deleting offline snapshot da05d167-89d3-47ce-9ba7-b33a9ff545f4 of volume 8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] snapshot_file for this snap is: volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb3d8a-1821-4d06-a63a-148ad0ac7889]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:49 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51 1073741824" returned: 0 in 0.553s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:49 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4
Nov 06 08:39:49 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:49 devstack sudo[107909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51
Nov 06 08:39:49 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:50 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:50 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.411s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41735258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:46Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Creating volume 1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:50 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4" returned: 0 in 0.451s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8764665f-9452-4cb4-a1d6-4c06322d7886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:50 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 1073741824
Nov 06 08:39:50 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668e5d29-65a1-43d4-b9a5-fe421b046218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c645497-2722-46eb-ac98-c25c4412cf51', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15143625-5fb7-4f3b-bf80-b950af9514b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f608ac-c2ad-44fe-85b7-0cc7de2d5d2b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:50 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Volume volume-5c645497-2722-46eb-ac98-c25c4412cf51 (5c645497-2722-46eb-ac98-c25c4412cf51): created successfully
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15143625-5fb7-4f3b-bf80-b950af9514b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (7e213062-0074-4172-a73c-afac75cdd00f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-3f72504f-d56d-4d59-82cd-a79ef5be4681 tempest-ProjectReaderTests-958435670 None] Created volume successfully.
Nov 06 08:39:50 devstack sudo[107918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886
Nov 06 08:39:50 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:50 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 1073741824" returned: 0 in 0.476s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:50 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354
Nov 06 08:39:50 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:50 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886" returned: 0 in 0.570s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:50 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4
Nov 06 08:39:50 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:50 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4510a9-3344-4090-b00e-2c9b8242fd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d781e9e-9f74-4808-baa4-bb6d7a50abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:50 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Volume volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 (1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354): created successfully
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d781e9e-9f74-4808-baa4-bb6d7a50abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (0e42d71d-db77-4fcd-8d38-cdf4909c94ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:50 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b5a72cf1-26dc-49ba-b3a6-0e1161a05268 tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-5c645497-2722-46eb-ac98-c25c4412cf51-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Lock "cinder-5c645497-2722-46eb-ac98-c25c4412cf51-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-quobyte-5c645497-2722-46eb-ac98-c25c4412cf51" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:50 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-5c645497-2722-46eb-ac98-c25c4412cf51" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a469bcf-8152-4233-a91c-30618deb6b07]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:51 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4" returned: 0 in 0.381s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:51 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4
Nov 06 08:39:51 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:51 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51
Nov 06 08:39:51 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:51 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886.da05d167-89d3-47ce-9ba7-b33a9ff545f4" returned: 0 in 0.252s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-da05d167-89d3-47ce-9ba7-b33a9ff545f4" released by "_delete_snapshot" :: held 1.799s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-8764665f-9452-4cb4-a1d6-4c06322d7886" released by "delete_snapshot" :: held 1.829s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:51 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51" returned: 0 in 0.375s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:51 devstack sudo[107943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51
Nov 06 08:39:51 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Created reservations ['9ff9451b-dfd9-4246-be3a-8a58b04f00aa', '2f9ff55b-7818-4027-b901-ac1b037eca83', 'aa5c5c4c-cfa9-45e5-8278-8adb1d28c239', '653da83a-2395-4b48-9b36-2c611820d9ba'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:51 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Delete snapshot completed successfully.
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-02e96d83-90fb-4578-8b58-f2d598435b2e tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-da05d167-89d3-47ce-9ba7-b33a9ff545f4-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:51 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-5c645497-2722-46eb-ac98-c25c4412cf51" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-5c645497-2722-46eb-ac98-c25c4412cf51" released by "delete_volume" :: held 0.675s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-8764665f-9452-4cb4-a1d6-4c06322d7886-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-8764665f-9452-4cb4-a1d6-4c06322d7886-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-quobyte-8764665f-9452-4cb4-a1d6-4c06322d7886" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Created reservations ['dfc47016-ea6d-481b-ad03-3bdb174c6a59', '804c8cf6-887a-46de-aa3b-8e61578dcbec', '4b16c3bb-c171-4a69-ab06-7ab638665b15', 'cc97d229-cde1-44f2-9169-6725308b7c8d'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-8764665f-9452-4cb4-a1d6-4c06322d7886" acquired by "delete_volume" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce2063-9e05-4f37-ab35-3855277e22ca]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:51 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:51 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:51 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:52 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886
Nov 06 08:39:52 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Creating offline snapshot b098f5b0-4535-46d3-9cd6-92fbb9f2978d of volume 1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04dd293-7603-4f75-a408-f0f153985859]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:52 devstack sudo[107950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354
Nov 06 08:39:52 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:52 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:52 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Deleted volume successfully.
Nov 06 08:39:52 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886" returned: 0 in 0.439s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-1b95f8bb-224d-4458-bde6-0bc1b48f57b1 tempest-ProjectReaderTests-958435670 None] Lock "cinder-5c645497-2722-46eb-ac98-c25c4412cf51-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:52 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886
Nov 06 08:39:52 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:52 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" returned: 0 in 0.506s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:52 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-8764665f-9452-4cb4-a1d6-4c06322d7886" returned: 0 in 0.268s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:52 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d 1G
Nov 06 08:39:52 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-8764665f-9452-4cb4-a1d6-4c06322d7886" released by "delete_volume" :: held 0.797s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (18069f44-8169-4a6c-a3e8-84a771cd9154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4af4ad-fe79-41bb-b725-04e732c94bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4af4ad-fe79-41bb-b725-04e732c94bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956138072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb7eeac-4e1a-4097-b4b7-a0065f129a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:53Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cd1dcd-b7f9-4f9b-a4a8-005d713e4eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cd1dcd-b7f9-4f9b-a4a8-005d713e4eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481452dc-e00e-4529-8877-9c7617c35f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481452dc-e00e-4529-8877-9c7617c35f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb7eeac-4e1a-4097-b4b7-a0065f129a9c', 'volume_name': 'volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ac4728-3d31-41f5-a81d-3bcab85ea2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ac4728-3d31-41f5-a81d-3bcab85ea2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddb53de-8007-4e28-b973-99ed595cbecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:52 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Volume 9cb7eeac-4e1a-4097-b4b7-a0065f129a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c', 'volume_size': 1}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Created reservations ['fc6fdb13-318b-4c10-b7af-3656a201f6a5', '25fbdbcc-7872-4e73-a4d4-0cae465b0e68', '6ac4e0ee-64ac-4dca-b84d-d64db237455b', '8336fa84-41d0-4f34-acf5-c1e26246e221'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:52 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:52 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:52 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:53 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d 1G" returned: 0 in 0.436s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:53 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d
Nov 06 08:39:53 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:53 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.263s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:53 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Deleted volume successfully.
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab48b9b9-17d5-45dc-9821-9a43c70cd53f tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-8764665f-9452-4cb4-a1d6-4c06322d7886-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:53 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d" returned: 0 in 0.287s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:53 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d is being set with open permissions: ugo+rw
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:53 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d
Nov 06 08:39:53 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:53 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:53 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.info
Nov 06 08:39:53 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:53 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.info" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:53 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.info is being set with open permissions: ugo+rw
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:53 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.info
Nov 06 08:39:53 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-d35ec026-dadb-4f2f-8399-72c9bf1bd399-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-d35ec026-dadb-4f2f-8399-72c9bf1bd399-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "cinder-quobyte-d35ec026-dadb-4f2f-8399-72c9bf1bd399" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:53 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-d35ec026-dadb-4f2f-8399-72c9bf1bd399" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb420ba1-b54b-463d-8485-a7ddbe0662c9]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:54 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.info" returned: 0 in 0.250s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956138072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb7eeac-4e1a-4097-b4b7-a0065f129a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27fc166c4774fdb8fd1137e22c77a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:53Z,use_quota=True,user_id='80b4d4b7f6e3400da24151f6e13d5c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Creating volume 9cb7eeac-4e1a-4097-b4b7-a0065f129a9c {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:54 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:54 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399
Nov 06 08:39:54 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:54 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c 1073741824
Nov 06 08:39:54 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2d206360-ee7a-4c04-8afa-662a36fb1d4c tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:39:54 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399" returned: 0 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:54 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399
Nov 06 08:39:54 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:54 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c 1073741824" returned: 0 in 0.447s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:54 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c
Nov 06 08:39:54 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:54 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-d35ec026-dadb-4f2f-8399-72c9bf1bd399" returned: 0 in 0.273s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-quobyte-d35ec026-dadb-4f2f-8399-72c9bf1bd399" released by "delete_volume" :: held 0.701s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Created reservations ['78992053-084f-48df-8ffc-4c90fc5e656f', 'e852e1b2-57c2-47a3-ac2e-4b4cac8362b7', '693d964c-e7b2-45bb-8881-2aa0785d2014', '866f1b34-015d-4ae7-a47d-070c07c779d0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:54 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:54 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:54 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddb53de-8007-4e28-b973-99ed595cbecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd36f3d-6a30-4b53-af40-9913378935d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:54 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Volume volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c (9cb7eeac-4e1a-4097-b4b7-a0065f129a9c): created successfully
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd36f3d-6a30-4b53-af40-9913378935d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:54 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Flow 'volume_create_manager' (18069f44-8169-4a6c-a3e8-84a771cd9154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:54 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a851f9f9-26fd-4e19-9630-04d3e8ed2489 tempest-ProjectReaderTests-958435670 None] Created volume successfully.
Nov 06 08:39:55 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:55 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Deleted volume successfully.
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-4367ce0a-373c-42c3-b1e6-a465c105e281 tempest-SnapshotDependencyTests-721993827 None] Lock "cinder-d35ec026-dadb-4f2f-8399-72c9bf1bd399-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-b098f5b0-4535-46d3-9cd6-92fbb9f2978d-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Lock "cinder-b098f5b0-4535-46d3-9cd6-92fbb9f2978d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-b098f5b0-4535-46d3-9cd6-92fbb9f2978d" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-b098f5b0-4535-46d3-9cd6-92fbb9f2978d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot b098f5b0-4535-46d3-9cd6-92fbb9f2978d of volume 1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[378026c4-b1af-4479-941b-21e14d015eea]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:55 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d
Nov 06 08:39:55 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:55 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d" returned: 0 in 0.370s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b16f331-d984-4b90-a506-36fff8b1aea8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:55 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354
Nov 06 08:39:55 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Lock "cinder-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Acquiring lock "cinder-quobyte-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:55 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[157381bb-0350-4e0e-9b26-341215465468]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:56 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" returned: 0 in 0.524s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:56 devstack sudo[108014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c
Nov 06 08:39:56 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:56 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d
Nov 06 08:39:56 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:56 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c" returned: 0 in 0.417s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:56 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c
Nov 06 08:39:56 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:56 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d" returned: 0 in 0.390s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:56 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d
Nov 06 08:39:56 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:56 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c" returned: 0 in 0.275s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Lock "cinder-quobyte-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c" released by "delete_volume" :: held 0.749s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Created reservations ['b42216f2-23d8-460f-83db-c17805a9096d', 'bfcbb7e5-d120-46d8-aef1-b76c2e6062d6', '334412f9-a7bd-4b23-a02e-732a7c3862fa', '3f34d022-ecbb-4a81-bee6-78947308f3d0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:56 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354.b098f5b0-4535-46d3-9cd6-92fbb9f2978d" returned: 0 in 0.274s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-b098f5b0-4535-46d3-9cd6-92fbb9f2978d" released by "_delete_snapshot" :: held 1.683s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" released by "delete_snapshot" :: held 1.713s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:56 devstack sudo[108035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:56 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:56 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Created reservations ['985bd421-2bcf-4d87-be17-d9c3afa0d161', '9c389844-15d0-49af-bc7c-0930ae8331e7', '2eebba92-9e2b-4ccb-9f91-a7dc07188385', 'd19ad876-c850-4a4f-91cb-e18f785bbe0b'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-94bbd9b7-ea46-4849-8e97-db9ec234cf74 tempest-ProjectMemberTests-493719806 None] Lock "cinder-b098f5b0-4535-46d3-9cd6-92fbb9f2978d-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:57 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.298s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:57 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Deleted volume successfully.
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2835e066-0147-460e-b5d4-53c1b9facdf3 tempest-ProjectReaderTests-958435670 None] Lock "cinder-9cb7eeac-4e1a-4097-b4b7-a0065f129a9c-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Lock "cinder-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" acquired by "delete_volume" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ca9cf-0ec2-4f2d-b4d4-4be8abc39ea3]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:57 devstack sudo[108039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354
Nov 06 08:39:57 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:57 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" returned: 0 in 0.397s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:57 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:57 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354
Nov 06 08:39:57 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:58 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" returned: 0 in 0.271s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354" released by "delete_volume" :: held 0.756s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Created reservations ['01b39025-6b3b-4f9e-a0e8-8b9fd013a506', '78a5487c-3179-4b73-bac8-42e91b1e0e11', '5f4bf1c9-d016-4803-a5d2-7d472bad84f0', 'd11f0f72-ef7f-4dbf-a9c2-7137621e3cb3'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:58 devstack sudo[108047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:39:58 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:58 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.259s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:39:58 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:39:58 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-56873561-6859-47f4-89fe-4c59dfe22a2e tempest-ProjectMemberTests-493719806 None] Lock "cinder-1cf88d7f-f63d-4ae3-9f0b-e4d7c905f354-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (ad240e7f-b6cb-41a6-98e0-49a84efe155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275da7de-5a7f-4edf-9376-3ab5611116e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275da7de-5a7f-4edf-9376-3ab5611116e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367024695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96b55cd-8773-4fb7-b1db-8a90ab9727a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:59Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6845d4-cf70-4c83-b6f9-a2bc6978db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6845d4-cf70-4c83-b6f9-a2bc6978db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08f7193-db92-4e8c-8b9b-297d2e0f798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08f7193-db92-4e8c-8b9b-297d2e0f798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96b55cd-8773-4fb7-b1db-8a90ab9727a2', 'volume_name': 'volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4937e9-6cb1-42e4-84ea-53a045d5d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4937e9-6cb1-42e4-84ea-53a045d5d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0329a404-c761-4c84-bcef-804929af2fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:39:59 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Volume e96b55cd-8773-4fb7-b1db-8a90ab9727a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2', 'volume_size': 1}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367024695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96b55cd-8773-4fb7-b1db-8a90ab9727a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:39:59Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Creating volume e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:39:59 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:59 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 1073741824
Nov 06 08:39:59 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:39:59 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 1073741824" returned: 0 in 0.476s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:39:59 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:39:59 devstack sudo[108057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2
Nov 06 08:39:59 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:00 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" returned: 0 in 0.259s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:00 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:40:00 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0329a404-c761-4c84-bcef-804929af2fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c8ef6-ca90-496c-a65a-224f0d688af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:00 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Volume volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 (e96b55cd-8773-4fb7-b1db-8a90ab9727a2): created successfully
Nov 06 08:40:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c8ef6-ca90-496c-a65a-224f0d688af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:00 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (ad240e7f-b6cb-41a6-98e0-49a84efe155c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:00 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6808f10d-5924-4b2d-89d3-9c1ae2ea57a0 tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:40:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:01 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Creating offline snapshot d69ddba5-6a11-43bb-8b2f-c10445e867ef of volume e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:40:01 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[545eae8f-ecec-432c-9bb7-04440e1c7151]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:01 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2
Nov 06 08:40:01 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:01 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" returned: 0 in 0.374s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:01 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:01 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef 1G
Nov 06 08:40:01 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:02 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef 1G" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:02 devstack sudo[108071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef
Nov 06 08:40:02 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:02 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef" returned: 0 in 0.279s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:02 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef is being set with open permissions: ugo+rw
Nov 06 08:40:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:02 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef
Nov 06 08:40:02 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:02 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:02 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:02 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.info
Nov 06 08:40:02 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:03 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.info" returned: 0 in 0.299s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:03 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.info is being set with open permissions: ugo+rw
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:03 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.info
Nov 06 08:40:03 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:03 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.info" returned: 0 in 0.255s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:03 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-510c65da-0315-4077-8ddd-4b0af73a385c tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-d69ddba5-6a11-43bb-8b2f-c10445e867ef-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Lock "cinder-d69ddba5-6a11-43bb-8b2f-c10445e867ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-d69ddba5-6a11-43bb-8b2f-c10445e867ef" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-d69ddba5-6a11-43bb-8b2f-c10445e867ef" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot d69ddba5-6a11-43bb-8b2f-c10445e867ef of volume e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9eedfa-0b7a-4a1e-8f16-f2f1c6eeb537]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:03 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:03 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef
Nov 06 08:40:03 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:04 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef" returned: 0 in 0.375s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c24974-e45d-48e8-b46c-b04fb7a6167a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:04 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2
Nov 06 08:40:04 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:04 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:04 devstack sudo[108099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef
Nov 06 08:40:04 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:04 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef" returned: 0 in 0.341s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:04 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:04 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef
Nov 06 08:40:04 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:05 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2.d69ddba5-6a11-43bb-8b2f-c10445e867ef" returned: 0 in 0.265s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-d69ddba5-6a11-43bb-8b2f-c10445e867ef" released by "_delete_snapshot" :: held 1.500s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" released by "delete_snapshot" :: held 1.532s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Created reservations ['880f190d-f624-40af-a6f0-b0e6172efd83', '11dba23b-80eb-42f8-b166-258a94017751', 'aa9b0168-0e33-46d2-913e-975474ceb365', '20a5ef1e-e04d-4504-9d23-d3fd6c2af234'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:05 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-a750bdad-ad10-49c9-b628-dba2ee037346 tempest-ProjectMemberTests-493719806 None] Lock "cinder-d69ddba5-6a11-43bb-8b2f-c10445e867ef-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-e96b55cd-8773-4fb7-b1db-8a90ab9727a2-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Lock "cinder-e96b55cd-8773-4fb7-b1db-8a90ab9727a2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[274d6ae6-a247-4c05-a104-94908c48bb0e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:05 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:05 devstack sudo[108109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2
Nov 06 08:40:05 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:06 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" returned: 0 in 0.362s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:06 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2
Nov 06 08:40:06 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:06 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-e96b55cd-8773-4fb7-b1db-8a90ab9727a2" released by "delete_volume" :: held 0.663s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Created reservations ['c1cd898b-46e0-4b25-8989-d480b49c0f09', 'af3af437-9e9f-41e8-84c7-37d606241fd9', 'cb9207a6-bd39-468c-b9ad-3d783dcbcb49', '4850f81d-f7ad-464e-b9f2-18929e9bf3b9'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:06 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:06 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:06 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.236s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:06 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:40:06 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-edf47dd5-6fef-4c7e-a95a-1e5f8ea0e1eb tempest-ProjectMemberTests-493719806 None] Lock "cinder-e96b55cd-8773-4fb7-b1db-8a90ab9727a2-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (a26879b0-f453-4643-81a6-284de550f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec0835-0912-4309-ae0f-addc0ec0a5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec0835-0912-4309-ae0f-addc0ec0a5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204334588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e4cca8-b9ab-4329-b4b4-884503f20e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:07Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1c32b0-e449-4969-89c6-c39d8b302860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1c32b0-e449-4969-89c6-c39d8b302860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd72ea66-2a57-48f3-850a-812423558773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd72ea66-2a57-48f3-850a-812423558773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e4cca8-b9ab-4329-b4b4-884503f20e14', 'volume_name': 'volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbaf219-8acd-44af-b3a1-0198e5016bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbaf219-8acd-44af-b3a1-0198e5016bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafea716-4ce6-4083-a655-ed28d3c46175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:07 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Volume b8e4cca8-b9ab-4329-b4b4-884503f20e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14', 'volume_size': 1}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204334588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e4cca8-b9ab-4329-b4b4-884503f20e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:07Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Creating volume b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:40:07 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:07 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 1073741824
Nov 06 08:40:07 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:07 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 1073741824" returned: 0 in 0.402s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:07 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:07 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14
Nov 06 08:40:07 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:08 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14" returned: 0 in 0.241s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafea716-4ce6-4083-a655-ed28d3c46175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9501c9-6bc7-4b73-baa1-db705ff1618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:08 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Volume volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 (b8e4cca8-b9ab-4329-b4b4-884503f20e14): created successfully
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9501c9-6bc7-4b73-baa1-db705ff1618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (a26879b0-f453-4643-81a6-284de550f98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:08 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-a7a1484f-922f-4850-a6e4-a06508d446ac tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Creating offline snapshot fc0ef047-3feb-4200-b142-60fe6ce8f9cd of volume b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ed0d1-5022-4805-8a10-05d398b91cda]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:08 devstack sudo[108130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14
Nov 06 08:40:08 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:08 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:08 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:08 devstack sudo[108135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd 1G
Nov 06 08:40:08 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:09 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd 1G" returned: 0 in 0.376s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:09 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd
Nov 06 08:40:09 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:09 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd" returned: 0 in 0.288s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:09 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd is being set with open permissions: ugo+rw
Nov 06 08:40:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:09 devstack sudo[108145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd
Nov 06 08:40:09 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:09 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:09 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:09 devstack sudo[108148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.info
Nov 06 08:40:09 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:10 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.info" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:10 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.info is being set with open permissions: ugo+rw
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:10 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.info
Nov 06 08:40:10 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:10 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.info" returned: 0 in 0.235s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:10 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-01870239-c548-4402-aa08-5fc61cae4ba8 tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-fc0ef047-3feb-4200-b142-60fe6ce8f9cd-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Lock "cinder-fc0ef047-3feb-4200-b142-60fe6ce8f9cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-b8e4cca8-b9ab-4329-b4b4-884503f20e14" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-b8e4cca8-b9ab-4329-b4b4-884503f20e14" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-fc0ef047-3feb-4200-b142-60fe6ce8f9cd" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-fc0ef047-3feb-4200-b142-60fe6ce8f9cd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot fc0ef047-3feb-4200-b142-60fe6ce8f9cd of volume b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95a5cc-bdc6-40b8-ba62-7aa4f5d0f8b8]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:10 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:10 devstack sudo[108154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd
Nov 06 08:40:10 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:11 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c680fe80-5260-4117-a962-6e26e140bded]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:11 devstack sudo[108159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14
Nov 06 08:40:11 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:11 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:11 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd
Nov 06 08:40:11 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:11 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd" returned: 0 in 0.326s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:11 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:11 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd
Nov 06 08:40:11 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:12 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14.fc0ef047-3feb-4200-b142-60fe6ce8f9cd" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-fc0ef047-3feb-4200-b142-60fe6ce8f9cd" released by "_delete_snapshot" :: held 1.367s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-b8e4cca8-b9ab-4329-b4b4-884503f20e14" released by "delete_snapshot" :: held 1.389s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Created reservations ['9804c5ec-633f-44ad-ae3d-ba945a1a732b', '28c434c8-b6b4-4915-8964-9c02bfbf854d', '34410b44-8a98-42b0-8321-b09d168a0029', '12569242-249c-47d7-8175-e509f00d5219'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:12 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-b4971f10-d1dc-4194-97c9-0c3ef9ed7863 tempest-ProjectMemberTests-493719806 None] Lock "cinder-fc0ef047-3feb-4200-b142-60fe6ce8f9cd-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-b8e4cca8-b9ab-4329-b4b4-884503f20e14-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Lock "cinder-b8e4cca8-b9ab-4329-b4b4-884503f20e14-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-b8e4cca8-b9ab-4329-b4b4-884503f20e14" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-b8e4cca8-b9ab-4329-b4b4-884503f20e14" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc78392-ef52-4eba-9283-38508503613d]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:12 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:12 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14
Nov 06 08:40:12 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:13 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14" returned: 0 in 0.351s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:13 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14
Nov 06 08:40:13 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:13 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-b8e4cca8-b9ab-4329-b4b4-884503f20e14" returned: 0 in 0.248s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-b8e4cca8-b9ab-4329-b4b4-884503f20e14" released by "delete_volume" :: held 0.658s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=155,cinder:INSERT=54,cinder:UPDATE=216,cinder:DELETE=20 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=199,cinder:SELECT=167,cinder:INSERT=55,cinder:DELETE=15 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Created reservations ['4482c741-d669-49fe-9a61-25e7ae53e3d2', '7ec4db9a-3c29-4214-a774-d617c037c7d8', '02362930-bb62-42d6-9607-8b65e8922607', '6cce5581-daae-4f73-877e-b62654166d26'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:13 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:13 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:13 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:13 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:40:13 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e2b44de5-afab-44a9-87a7-342323569994 tempest-ProjectMemberTests-493719806 None] Lock "cinder-b8e4cca8-b9ab-4329-b4b4-884503f20e14-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (5a33c403-f4b8-410a-9d43-118c1687a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51bba48-f640-4f19-9e4f-dbeeae1c481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51bba48-f640-4f19-9e4f-dbeeae1c481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325223954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759dd70d-e14a-423c-9d14-00dc519800b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:14Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51ce899-7448-4ede-987a-c152a4c83931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51ce899-7448-4ede-987a-c152a4c83931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54fb733-bc89-4024-a1b1-4c39132fee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54fb733-bc89-4024-a1b1-4c39132fee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759dd70d-e14a-423c-9d14-00dc519800b9', 'volume_name': 'volume-759dd70d-e14a-423c-9d14-00dc519800b9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38656dfd-af4a-49f5-83dd-a00498224ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38656dfd-af4a-49f5-83dd-a00498224ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d2028c-9a80-4f4b-b685-e9c54db7dd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:14 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Volume 759dd70d-e14a-423c-9d14-00dc519800b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759dd70d-e14a-423c-9d14-00dc519800b9', 'volume_size': 1}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325223954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759dd70d-e14a-423c-9d14-00dc519800b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:14Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Creating volume 759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:40:14 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:14 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 1073741824
Nov 06 08:40:14 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:14 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 1073741824" returned: 0 in 0.403s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:14 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:14 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9
Nov 06 08:40:14 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:15 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9" returned: 0 in 0.248s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d2028c-9a80-4f4b-b685-e9c54db7dd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759dd70d-e14a-423c-9d14-00dc519800b9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58257484-d0b2-4783-85c9-82971a0994d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:15 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Volume volume-759dd70d-e14a-423c-9d14-00dc519800b9 (759dd70d-e14a-423c-9d14-00dc519800b9): created successfully
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58257484-d0b2-4783-85c9-82971a0994d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (5a33c403-f4b8-410a-9d43-118c1687a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:15 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-806ec377-97e9-4cea-a68f-bdec18761d9b tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Creating offline snapshot 67d33b82-4afa-4983-9e97-47e8dbfc3a18 of volume 759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6693be-7a7a-4e2f-af04-54b2dba51237]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:15 devstack sudo[108199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9
Nov 06 08:40:15 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:15 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9" returned: 0 in 0.351s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:15 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:15 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 1G
Nov 06 08:40:15 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:16 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 1G" returned: 0 in 0.382s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759dd70d-e14a-423c-9d14-00dc519800b9 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:16 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759dd70d-e14a-423c-9d14-00dc519800b9 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18
Nov 06 08:40:16 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:16 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759dd70d-e14a-423c-9d14-00dc519800b9 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18" returned: 0 in 0.292s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:16 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 is being set with open permissions: ugo+rw
Nov 06 08:40:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:16 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18
Nov 06 08:40:16 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:16 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:16 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:16 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.info
Nov 06 08:40:16 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:17 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.info" returned: 0 in 0.249s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:17 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.info is being set with open permissions: ugo+rw
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:17 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.info
Nov 06 08:40:17 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:17 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.info" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:17 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9c057815-0746-4b1e-aeba-662412629aa5 tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-67d33b82-4afa-4983-9e97-47e8dbfc3a18-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Lock "cinder-67d33b82-4afa-4983-9e97-47e8dbfc3a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-759dd70d-e14a-423c-9d14-00dc519800b9" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-759dd70d-e14a-423c-9d14-00dc519800b9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-67d33b82-4afa-4983-9e97-47e8dbfc3a18" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-67d33b82-4afa-4983-9e97-47e8dbfc3a18" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot 67d33b82-4afa-4983-9e97-47e8dbfc3a18 of volume 759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e003639-431d-485f-b02d-7714edc977c0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:17 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:17 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18
Nov 06 08:40:17 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:18 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759dd70d-e14a-423c-9d14-00dc519800b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[571e5fce-1014-469f-96de-f4ac317d1129]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:18 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9
Nov 06 08:40:18 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:18 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:18 devstack sudo[108270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18
Nov 06 08:40:18 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:18 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18" returned: 0 in 0.320s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:18 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:18 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18
Nov 06 08:40:18 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:19 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9.67d33b82-4afa-4983-9e97-47e8dbfc3a18" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-67d33b82-4afa-4983-9e97-47e8dbfc3a18" released by "_delete_snapshot" :: held 1.363s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-759dd70d-e14a-423c-9d14-00dc519800b9" released by "delete_snapshot" :: held 1.389s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Created reservations ['f3e604cd-86b7-4289-adb4-f98322d9bdbc', '480ad935-dc1b-47b3-b7e9-cbe4d863d406', '3762ec78-2a93-455c-b62b-0280cbab17a3', '59999b6f-7e1a-4ccd-b746-f510c083699e'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:19 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-e1a8c4d3-8ad3-4beb-9f8e-c5660db0c384 tempest-ProjectMemberTests-493719806 None] Lock "cinder-67d33b82-4afa-4983-9e97-47e8dbfc3a18-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-759dd70d-e14a-423c-9d14-00dc519800b9-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Lock "cinder-759dd70d-e14a-423c-9d14-00dc519800b9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-759dd70d-e14a-423c-9d14-00dc519800b9" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-759dd70d-e14a-423c-9d14-00dc519800b9" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe4e779-1299-4f6e-90b0-b53a4baecd80]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:19 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:20 devstack sudo[108279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9
Nov 06 08:40:20 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:20 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9" returned: 0 in 0.351s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:20 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9
Nov 06 08:40:20 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:20 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-759dd70d-e14a-423c-9d14-00dc519800b9" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-759dd70d-e14a-423c-9d14-00dc519800b9" released by "delete_volume" :: held 0.657s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Created reservations ['10d2c25b-4c2f-4e44-811a-b1507588194a', '9b11f394-9f0d-4b9d-8b94-71563b8d6653', 'b634f863-e857-426c-a2e6-0471c6b428e8', '0cb48423-0a07-4cff-ae4c-5cd964d159b3'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:20 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:20 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:20 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:20 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:40:20 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-6012ff2d-42fc-44cb-81f4-edb47a501228 tempest-ProjectMemberTests-493719806 None] Lock "cinder-759dd70d-e14a-423c-9d14-00dc519800b9-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (e5f6fd4e-f642-4d8f-b5e8-80f5b785dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6e9fe6-aeec-4bb8-a15a-c3c0ecd1f6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6e9fe6-aeec-4bb8-a15a-c3c0ecd1f6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771413988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e99f3bc-27de-4a6c-8c89-aeed3574c4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:21Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed5dfaf-60d6-4258-b47d-796143fa7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed5dfaf-60d6-4258-b47d-796143fa7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe01c824-e7e3-4dad-a843-f2a9dfad6bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe01c824-e7e3-4dad-a843-f2a9dfad6bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e99f3bc-27de-4a6c-8c89-aeed3574c4a9', 'volume_name': 'volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99b7645-a68f-48d6-8fa2-49b245ba6030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99b7645-a68f-48d6-8fa2-49b245ba6030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a728fc-b28b-4d87-a3b3-5d7bc3992b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:21 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Volume 3e99f3bc-27de-4a6c-8c89-aeed3574c4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9', 'volume_size': 1}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771413988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e99f3bc-27de-4a6c-8c89-aeed3574c4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:21Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Creating volume 3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:40:21 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:21 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 1073741824
Nov 06 08:40:21 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:21 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 1073741824" returned: 0 in 0.401s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:21 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:21 devstack sudo[108297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9
Nov 06 08:40:21 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:22 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a728fc-b28b-4d87-a3b3-5d7bc3992b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1185465c-eb4c-449e-aa9b-7539a05a2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:22 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Volume volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 (3e99f3bc-27de-4a6c-8c89-aeed3574c4a9): created successfully
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1185465c-eb4c-449e-aa9b-7539a05a2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (e5f6fd4e-f642-4d8f-b5e8-80f5b785dde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:22 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-aaeb69ca-5227-47c2-a3f7-993ba67582a4 tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Creating offline snapshot f0fd450b-17c2-4bed-9cbd-449057e968f6 of volume 3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4821a2-e560-43be-8f81-4e471c909392]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:22 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9
Nov 06 08:40:22 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:22 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" returned: 0 in 0.348s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:22 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:23 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 1G
Nov 06 08:40:23 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:23 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 1G" returned: 0 in 0.378s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:23 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6
Nov 06 08:40:23 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:23 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6" returned: 0 in 0.294s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:23 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 is being set with open permissions: ugo+rw
Nov 06 08:40:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:23 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6
Nov 06 08:40:23 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:23 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:23 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:23 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.info
Nov 06 08:40:23 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:24 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.info" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:24 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.info is being set with open permissions: ugo+rw
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:24 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.info
Nov 06 08:40:24 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:24 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.info" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:24 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-15ea4810-d7cc-4122-b533-872a2f9b29cc tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-f0fd450b-17c2-4bed-9cbd-449057e968f6-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Lock "cinder-f0fd450b-17c2-4bed-9cbd-449057e968f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-f0fd450b-17c2-4bed-9cbd-449057e968f6" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-f0fd450b-17c2-4bed-9cbd-449057e968f6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot f0fd450b-17c2-4bed-9cbd-449057e968f6 of volume 3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[399d01c6-9640-4431-9d5a-acf3fcbd70b0]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:24 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:24 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6
Nov 06 08:40:24 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:25 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6" returned: 0 in 0.356s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e83caa-d0a2-4727-b35f-28f9c06929c5]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:25 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9
Nov 06 08:40:25 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:25 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" returned: 0 in 0.361s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:25 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6
Nov 06 08:40:25 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:25 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6" returned: 0 in 0.325s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:25 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:25 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6
Nov 06 08:40:25 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:26 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9.f0fd450b-17c2-4bed-9cbd-449057e968f6" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-f0fd450b-17c2-4bed-9cbd-449057e968f6" released by "_delete_snapshot" :: held 1.378s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" released by "delete_snapshot" :: held 1.398s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Created reservations ['ecb0b4c8-e926-4dcf-864f-8a5e459eb8db', 'f4735afa-d9cb-4047-a9c0-a403966bf11d', 'd266f7ac-dcdb-4aa8-941d-295a4d5975fd', '53cb601c-6efa-4901-a419-99ea235845d7'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:26 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-0d7b006b-f113-4e3f-b445-c760b0f84910 tempest-ProjectMemberTests-493719806 None] Lock "cinder-f0fd450b-17c2-4bed-9cbd-449057e968f6-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Lock "cinder-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:26 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d9b2c-8eb4-4662-b682-2335cba08956]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:27 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9
Nov 06 08:40:27 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:27 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" returned: 0 in 0.346s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:27 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9
Nov 06 08:40:27 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:27 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" returned: 0 in 0.248s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9" released by "delete_volume" :: held 0.656s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Created reservations ['8213f9a1-55fc-4fac-be3d-0e5cd876c194', '66aba9eb-d34e-4012-8ee7-8d5406ca7712', 'b92d30fb-377b-4764-a9a4-5ca2e6b44287', 'bbeaae9a-34c5-4041-a29d-f22ab6d0ecbf'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:27 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:27 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:27 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.261s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:27 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:27 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-2d9f98ef-c48f-4ace-a06b-964284515924 tempest-ProjectMemberTests-493719806 None] Lock "cinder-3e99f3bc-27de-4a6c-8c89-aeed3574c4a9-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (bd934498-fc07-41ce-a39c-6d5f7ad754fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355b64e3-ccb4-4124-9f42-f0b29571baf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355b64e3-ccb4-4124-9f42-f0b29571baf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555748155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4480b04e-91c1-4f87-b5b5-3797448b70de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:28Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921b00f3-ad3e-4bad-a378-889962a3ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921b00f3-ad3e-4bad-a378-889962a3ac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc510917-56f6-4665-b5cd-9eb7a9d1a552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc510917-56f6-4665-b5cd-9eb7a9d1a552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4480b04e-91c1-4f87-b5b5-3797448b70de', 'volume_name': 'volume-4480b04e-91c1-4f87-b5b5-3797448b70de', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86dc768-f21b-4bcf-a5d6-d52617ceac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86dc768-f21b-4bcf-a5d6-d52617ceac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de351f28-2335-4554-9360-3fdf3adc045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:28 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Volume 4480b04e-91c1-4f87-b5b5-3797448b70de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4480b04e-91c1-4f87-b5b5-3797448b70de', 'volume_size': 1}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555748155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4480b04e-91c1-4f87-b5b5-3797448b70de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:28Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Creating volume 4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:40:28 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:28 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de 1073741824
Nov 06 08:40:28 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:28 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:28 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de 1073741824" returned: 0 in 0.401s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:29 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de
Nov 06 08:40:29 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:29 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de351f28-2335-4554-9360-3fdf3adc045c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4480b04e-91c1-4f87-b5b5-3797448b70de', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924ce233-4eb5-4d6b-a91a-e09011b85eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:29 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Volume volume-4480b04e-91c1-4f87-b5b5-3797448b70de (4480b04e-91c1-4f87-b5b5-3797448b70de): created successfully
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924ce233-4eb5-4d6b-a91a-e09011b85eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (bd934498-fc07-41ce-a39c-6d5f7ad754fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:29 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-867b789b-8a8c-4f39-b7db-0a6a81dda5de tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Creating offline snapshot 2f6b92b7-9735-4ce1-96b7-ea39c86117fb of volume 4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd0b37a-7eb9-4df4-8ab3-16eb40c83324]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:29 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:29 devstack sudo[108364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de
Nov 06 08:40:29 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:30 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de" returned: 0 in 0.348s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:30 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb 1G
Nov 06 08:40:30 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:30 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb 1G" returned: 0 in 0.393s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4480b04e-91c1-4f87-b5b5-3797448b70de -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:30 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4480b04e-91c1-4f87-b5b5-3797448b70de -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb
Nov 06 08:40:30 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:30 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:30 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:30 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4480b04e-91c1-4f87-b5b5-3797448b70de -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb" returned: 0 in 0.295s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:30 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb is being set with open permissions: ugo+rw
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:30 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.254s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:30 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:40:30 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 08:40:30 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:30 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.info
Nov 06 08:40:30 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:31 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.info" returned: 0 in 0.247s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:31 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.info is being set with open permissions: ugo+rw
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:31 devstack sudo[108388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.info
Nov 06 08:40:31 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:31 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.info" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:31 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ba9d61b9-69a4-497a-8c3c-60e4337c86c6 tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-2f6b92b7-9735-4ce1-96b7-ea39c86117fb-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-2f6b92b7-9735-4ce1-96b7-ea39c86117fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-4480b04e-91c1-4f87-b5b5-3797448b70de" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4480b04e-91c1-4f87-b5b5-3797448b70de" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-2f6b92b7-9735-4ce1-96b7-ea39c86117fb" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-2f6b92b7-9735-4ce1-96b7-ea39c86117fb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot 2f6b92b7-9735-4ce1-96b7-ea39c86117fb of volume 4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbca8f7-1d70-4c87-b057-0c9c77759703]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:31 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:31 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb
Nov 06 08:40:31 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:32 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb" returned: 0 in 0.352s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4480b04e-91c1-4f87-b5b5-3797448b70de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f74744-6967-42bc-8cd0-26b234ca99f1]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:32 devstack sudo[108396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de
Nov 06 08:40:32 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:32 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de" returned: 0 in 0.358s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:32 devstack sudo[108401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb
Nov 06 08:40:32 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:32 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb" returned: 0 in 0.332s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:32 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:32 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb
Nov 06 08:40:32 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:33 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de.2f6b92b7-9735-4ce1-96b7-ea39c86117fb" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-2f6b92b7-9735-4ce1-96b7-ea39c86117fb" released by "_delete_snapshot" :: held 1.375s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4480b04e-91c1-4f87-b5b5-3797448b70de" released by "delete_snapshot" :: held 1.395s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Created reservations ['41b8f5e1-c480-4620-8f1d-2494466231d9', '3535ea72-bf00-4e84-8647-c89f5d0c7c5f', 'caaf6106-5f84-4ff7-befe-dfd40ba86651', 'db781348-2163-4a38-b980-2fbf70e72fa0'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:33 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ab5a7581-568f-4e19-a720-be35704072a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-2f6b92b7-9735-4ce1-96b7-ea39c86117fb-delete_snapshot" released by "delete_snapshot" :: held 1.520s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-4480b04e-91c1-4f87-b5b5-3797448b70de-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Lock "cinder-4480b04e-91c1-4f87-b5b5-3797448b70de-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-4480b04e-91c1-4f87-b5b5-3797448b70de" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:33 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4480b04e-91c1-4f87-b5b5-3797448b70de" acquired by "delete_volume" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[134aee91-1a50-48c3-a046-72782f7f3b4e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:34 devstack sudo[108409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de
Nov 06 08:40:34 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:34 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:34 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de
Nov 06 08:40:34 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:34 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4480b04e-91c1-4f87-b5b5-3797448b70de" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4480b04e-91c1-4f87-b5b5-3797448b70de" released by "delete_volume" :: held 0.658s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Created reservations ['b153bde1-eb11-446e-b260-2ba324030c65', '4c023f4e-e72b-4c75-84b3-6c45e9b39d06', '64ba8146-b203-47c0-b18c-d08bf98551cd', '390f55f9-6c03-409e-b48e-4445eb2ae80c'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:34 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:34 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:34 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.245s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:34 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:34 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-891a082d-d4af-4d84-8b3c-c5571d7488ae tempest-ProjectMemberTests-493719806 None] Lock "cinder-4480b04e-91c1-4f87-b5b5-3797448b70de-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (987254d2-2a64-4362-8d71-61b5fa51ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b99c3b3-0a9d-402b-b7c2-04c95808a63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b99c3b3-0a9d-402b-b7c2-04c95808a63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122253538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:35Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d69630a-4164-4bec-85ec-c94c21e07266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d69630a-4164-4bec-85ec-c94c21e07266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971cef81-eda0-4b0b-99e3-834150c1ceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971cef81-eda0-4b0b-99e3-834150c1ceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3', 'volume_name': 'volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4112c1ca-591e-47a4-b953-9b4c75977ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4112c1ca-591e-47a4-b953-9b4c75977ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc352e8-b498-4225-ae2b-0d074154e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:35 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Volume 4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3', 'volume_size': 1}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122253538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:35Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Creating volume 4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:40:35 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:40:35 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:35 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 1073741824
Nov 06 08:40:35 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:36 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 1073741824" returned: 0 in 0.401s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:36 devstack sudo[108425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3
Nov 06 08:40:36 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:36 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" returned: 0 in 0.244s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc352e8-b498-4225-ae2b-0d074154e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd5edc1-dc61-4e6a-bcbc-d84d1263d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:36 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Volume volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 (4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3): created successfully
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd5edc1-dc61-4e6a-bcbc-d84d1263d798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (987254d2-2a64-4362-8d71-61b5fa51ce71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:36 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-e2776663-f443-4050-b5d2-efc973cb0df9 tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Creating offline snapshot 8824fce7-62af-4a97-aca1-df2f0f9b0390 of volume 4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db673c-3c58-4a7c-9b1c-6e1177bf4fb6]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:36 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:36 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3
Nov 06 08:40:36 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:37 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" returned: 0 in 0.354s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:37 devstack sudo[108433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 1G
Nov 06 08:40:37 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:37 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 1G" returned: 0 in 0.382s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:37 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390
Nov 06 08:40:37 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:37 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390" returned: 0 in 0.289s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:37 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 is being set with open permissions: ugo+rw
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:37 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390
Nov 06 08:40:37 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:37 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390" returned: 0 in 0.236s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:37 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:38 devstack sudo[108448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.info
Nov 06 08:40:38 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:38 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.info" returned: 0 in 0.249s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:38 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.info is being set with open permissions: ugo+rw
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:38 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.info
Nov 06 08:40:38 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:38 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.info" returned: 0 in 0.240s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:38 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-9214ec6c-7ce4-4c58-9cd0-00eda91140a3 tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-8824fce7-62af-4a97-aca1-df2f0f9b0390-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-8824fce7-62af-4a97-aca1-df2f0f9b0390-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-8824fce7-62af-4a97-aca1-df2f0f9b0390" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-8824fce7-62af-4a97-aca1-df2f0f9b0390" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot 8824fce7-62af-4a97-aca1-df2f0f9b0390 of volume 4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ed4d0-cf27-4f44-83db-9d4dc9a8dcab]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:38 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:38 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390
Nov 06 08:40:38 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:39 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390" returned: 0 in 0.347s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[17159894-66f2-412e-ba25-3a3d9d539c6b]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:39 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3
Nov 06 08:40:39 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:39 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" returned: 0 in 0.346s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:39 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390
Nov 06 08:40:39 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:39 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390" returned: 0 in 0.322s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:39 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:39 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390
Nov 06 08:40:39 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:40 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3.8824fce7-62af-4a97-aca1-df2f0f9b0390" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-8824fce7-62af-4a97-aca1-df2f0f9b0390" released by "_delete_snapshot" :: held 1.344s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" released by "delete_snapshot" :: held 1.365s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Created reservations ['a9dc94c3-aa0f-457c-a12e-87613c4795e7', '20d38e50-d2fe-49f1-b3eb-5c815737218e', 'ecf44d0b-b498-48f2-9db4-4cd17bc42a7c', '5f106134-76ca-42f5-b439-fb9ca07b8f1f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:40 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-77acb2eb-1590-414a-a970-189fe44c09a1 tempest-ProjectMemberTests-493719806 None] Lock "cinder-8824fce7-62af-4a97-aca1-df2f0f9b0390-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Lock "cinder-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:40 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" acquired by "delete_volume" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9cc2b4-0448-4a5e-86a6-846a18a16130]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:41 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3
Nov 06 08:40:41 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:41 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" returned: 0 in 0.357s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:41 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3
Nov 06 08:40:41 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:41 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" returned: 0 in 0.243s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3" released by "delete_volume" :: held 0.657s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Created reservations ['1ad97210-352b-41d6-ab2e-fb99e1f19385', 'ba305728-d365-4816-8d6b-0da86c094809', 'e8a9f9e5-f61a-4f2a-bad8-cca8a4dfc347', 'fb649ec6-14cc-40e9-b7e0-d25a786e59e5'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:41 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:41 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:41 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.231s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:41 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:42 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-778aa703-a3c7-4abc-be3c-b69f7e0b26ac tempest-ProjectMemberTests-493719806 None] Lock "cinder-4f7ff31d-fd10-4afa-8c31-e3e76c5fe3a3-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87143) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (c1be36a0-9e12-4082-85c1-80da3cbfe60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d82e8ba-3e4f-421b-b32a-2008348c19eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d82e8ba-3e4f-421b-b32a-2008348c19eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044545129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c75dd2-a463-4a34-8ade-74fdc6c6e8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:42Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1f56b0-93ba-4a6d-83cf-015c645c6e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1f56b0-93ba-4a6d-83cf-015c645c6e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f29f97f-517f-45d1-a22d-eb2ae49e5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f29f97f-517f-45d1-a22d-eb2ae49e5934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c75dd2-a463-4a34-8ade-74fdc6c6e8b3', 'volume_name': 'volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf567b7-90ae-435f-aaa3-ebf0c1f885fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf567b7-90ae-435f-aaa3-ebf0c1f885fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e407d0d-96da-4d52-842e-a6c9adc7add1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:42 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Volume 90c75dd2-a463-4a34-8ade-74fdc6c6e8b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3', 'volume_size': 1}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd1078a92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T07:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044545129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c75dd2-a463-4a34-8ade-74fdc6c6e8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3c9937f424464a8a472e55f1468a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T07:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T07:40:42Z,use_quota=True,user_id='0aa099525df7405d8231efaf94b9911d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5c0500-520e-4053-b03c-0868af1c0eb8),volume_type_id=9a5c0500-520e-4053-b03c-0868af1c0eb8)}" {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Creating volume 90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Selected osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee as target Quobyte volume. {{(pid=87143) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 08:40:42 devstack cinder-volume[87143]: INFO cinder.volume.drivers.remotefs [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] casted to osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee
Nov 06 08:40:42 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 1073741824 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:42 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 1073741824
Nov 06 08:40:42 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:42 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 1073741824" returned: 0 in 0.409s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:43 devstack sudo[108488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3
Nov 06 08:40:43 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:43 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" returned: 0 in 0.246s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'} {{(pid=87143) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e407d0d-96da-4d52-842e-a6c9adc7add1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3', 'volume_size': 1}' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7320af02-4fd6-49c8-8dac-266bb8a45223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 08:40:43 devstack cinder-volume[87143]: INFO cinder.volume.flows.manager.create_volume [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Volume volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 (90c75dd2-a463-4a34-8ade-74fdc6c6e8b3): created successfully
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7320af02-4fd6-49c8-8dac-266bb8a45223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87143) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Flow 'volume_create_manager' (c1be36a0-9e12-4082-85c1-80da3cbfe60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87143) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 08:40:43 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-4cf37c85-46a1-4bb7-8a36-d8b5015e295f tempest-ProjectMemberTests-493719806 None] Created volume successfully.
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Creating offline snapshot 60013bb1-099e-4934-843b-be23a94a55ba of volume 90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec052f2-6b4a-486c-b8a4-7226797ded7e]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:43 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:43 devstack sudo[108491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3
Nov 06 08:40:43 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:44 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" returned: 0 in 0.367s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba 1G {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:44 devstack sudo[108496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba 1G
Nov 06 08:40:44 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:44 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba 1G" returned: 0 in 0.398s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:44 devstack sudo[108501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba
Nov 06 08:40:44 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:44 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 -F qcow2 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba" returned: 0 in 0.296s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:44 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba is being set with open permissions: ugo+rw
Nov 06 08:40:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:44 devstack sudo[108506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba
Nov 06 08:40:44 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:44 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:44 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba" returned: 0 in 0.237s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:45 devstack sudo[108509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.info
Nov 06 08:40:45 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:45 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.info" returned: 0 in 0.257s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:45 devstack cinder-volume[87143]: WARNING cinder.volume.drivers.remotefs [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.info is being set with open permissions: ugo+rw
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.info {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:45 devstack sudo[108512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.info
Nov 06 08:40:45 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:45 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.info" returned: 0 in 0.239s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:45 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-95f4300f-87fc-4d88-9af8-68b0a021a5d2 tempest-ProjectMemberTests-493719806 None] Create snapshot completed successfully
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-60013bb1-099e-4934-843b-be23a94a55ba-delete_snapshot" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Lock "cinder-60013bb1-099e-4934-843b-be23a94a55ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" by "delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-60013bb1-099e-4934-843b-be23a94a55ba" by "_delete_snapshot" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-60013bb1-099e-4934-843b-be23a94a55ba" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Deleting offline snapshot 60013bb1-099e-4934-843b-be23a94a55ba of volume 90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] snapshot_file for this snap is: volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba {{(pid=87143) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[626c54ec-25d3-4733-aab1-17550fc10809]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:45 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:46 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba
Nov 06 08:40:46 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:46 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba" returned: 0 in 0.355s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:46 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.remotefs [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87143) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 08:40:46 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[30175736-e135-4549-b1e4-610acbe706d7]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:46 devstack sudo[108520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3
Nov 06 08:40:46 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:46 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" returned: 0 in 0.344s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:46 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:46 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba
Nov 06 08:40:46 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:47 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba" returned: 0 in 0.347s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:47 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba
Nov 06 08:40:47 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:47 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:47 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3.60013bb1-099e-4934-843b-be23a94a55ba" returned: 0 in 0.242s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-60013bb1-099e-4934-843b-be23a94a55ba" released by "_delete_snapshot" :: held 1.378s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" released by "delete_snapshot" :: held 1.400s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:47 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Created reservations ['9afe481b-f3fa-40cc-8fe6-ea52828fc55d', '15faa072-1a2f-49ed-8ff9-d867393340f9', 'f6bb3da3-9e14-47a5-aad5-033f54f8758d', '3dbdd717-2840-48ca-b6f2-ffcab964615f'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:47 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Delete snapshot completed successfully.
Nov 06 08:40:47 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-ca8a5edc-b8ae-45e6-bc8d-25998169a58c tempest-ProjectMemberTests-493719806 None] Lock "cinder-60013bb1-099e-4934-843b-be23a94a55ba-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3-delete_volume" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Lock "cinder-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Acquiring lock "cinder-quobyte-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" by "delete_volume" {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87143) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0abd5d0-64f5-4ea5-8f78-6e244923d18a]: (4, 'qcow2') {{(pid=88041) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:48 devstack sudo[108534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3
Nov 06 08:40:48 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:48 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" returned: 0 in 0.356s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3 {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:48 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3
Nov 06 08:40:48 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:48 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a/volume-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" returned: 0 in 0.238s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Lock "cinder-quobyte-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3" released by "delete_volume" :: held 0.652s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.quota [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Created reservations ['022828c4-f427-464a-b737-f1888f535ddc', 'c9232dc1-01d9-4837-bcbc-39930fb34fe9', 'f36254aa-3b4c-4377-bc9e-8574ba55a21e', 'c609dea2-bd46-4122-943b-030b5faa083b'] {{(pid=87143) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:40:48 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:40:48 devstack sudo[108542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:40:48 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:40:49 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root
Nov 06 08:40:49 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.236s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:40:49 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:40:49 devstack cinder-volume[87143]: INFO cinder.volume.manager [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Deleted volume successfully.
Nov 06 08:40:49 devstack cinder-volume[87143]: DEBUG cinder.coordination [None req-567548aa-48d4-439b-b340-a1bab6addb9f tempest-ProjectMemberTests-493719806 None] Lock "cinder-90c75dd2-a463-4a34-8ade-74fdc6c6e8b3-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87143) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 08:40:58 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:SELECT=71,cinder:INSERT=34,cinder:UPDATE=102,cinder:DELETE=7 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:40:59 devstack cinder-volume[87143]: DEBUG dbcounter [-] [87143] Writing DB stats cinder:UPDATE=94,cinder:SELECT=76,cinder:DELETE=9,cinder:INSERT=20 {{(pid=87143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee': None} {{(pid=87143) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG cinder.volume.drivers.quobyte [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3fcf0770-8c43-4939-a56a-bb4b05b763ee'] {{(pid=87143) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.lockutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87143) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 08:41:30 devstack sudo[108783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a
Nov 06 08:41:30 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 08:41:30 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG oslo_concurrency.processutils [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43c5afc83e3440fff5a4cdac46cf2d2a" returned: 0 in 0.258s {{(pid=87143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG cinder.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Notifying Schedulers of capabilities ... {{(pid=87143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG oslo_service.periodic_task [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] Running periodic task VolumeManager._thread_info {{(pid=87143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread count: 29 {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 08:41:30 devstack cinder-volume[87143]: DEBUG cinder.volume.manager [None req-90bfc808-a4fa-49ef-9122-11a4b9f1923b None None] thread info: [<_MainThread(MainThread, started 137237331583104)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137237216915328)>, <Thread(Thread-3 (stat_writer), started daemon 137237215357120)>, <Thread(Rabbit-heartbeat, started daemon 137237214102144)>, <Thread(Thread-5 (_runner), started daemon 137237214206912)>, <Thread(Thread-7 (_runner), started daemon 137237214351808)>, <Thread(fd_logger, started daemon 137237212037312)>, <Thread(privsep_reader, started daemon 137237213912320)>, <Thread(tpool_thread_0, started daemon 137237204633280)>, <Thread(tpool_thread_1, started daemon 137237196240576)>, <Thread(tpool_thread_2, started daemon 137237187847872)>, <Thread(tpool_thread_3, started daemon 137237179455168)>, <Thread(tpool_thread_4, started daemon 137237171062464)>, <Thread(tpool_thread_5, started daemon 137237162669760)>, <Thread(tpool_thread_6, started daemon 137237154277056)>, <Thread(tpool_thread_7, started daemon 137237145884352)>, <Thread(tpool_thread_8, started daemon 137237137491648)>, <Thread(tpool_thread_9, started daemon 137237129098944)>, <Thread(tpool_thread_10, started daemon 137237120706240)>, <Thread(tpool_thread_11, started daemon 137237112313536)>, <Thread(tpool_thread_12, started daemon 137237103920832)>, <Thread(tpool_thread_13, started daemon 137237095528128)>, <Thread(tpool_thread_14, started daemon 137237087135424)>, <Thread(tpool_thread_15, started daemon 137237078742720)>, <Thread(tpool_thread_16, started daemon 137237070350016)>, <Thread(tpool_thread_17, started daemon 137237061957312)>, <Thread(tpool_thread_18, started daemon 137237053564608)>, <Thread(tpool_thread_19, started daemon 137237045171904)>, <Thread(Rabbit-heartbeat, started daemon 137237209730432)>] {{(pid=87143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}